Hook up new LLM abstraction with agents and programs (#6679)

* add to agent and programs

* wip

* update notebook

* wip

* wip

* wiup

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* remove unused imports

* update change log