diff --git a/docs/examples/llm/ollama_gemma.ipynb b/docs/examples/llm/ollama_gemma.ipynb
index 1f9719014710858f72cb27da3643124ac4a7d759..47445cb9ff3ab31d956c495990432b7e876922a1 100644
--- a/docs/examples/llm/ollama_gemma.ipynb
+++ b/docs/examples/llm/ollama_gemma.ipynb
@@ -28,6 +28,7 @@
"\n",
"[Gemma](https://blog.google/technology/developers/gemma-open-models/): a family of lightweight, state-of-the-art open models built by Google DeepMind. Available in 2b and 7b parameter sizes\n",
"\n",
+ "[Ollama](https://ollama.com/library/gemma): Support both 2b and 7b models\n",
"\n",
"Note: `please install ollama>=0.1.26`\n",
"You can download pre-release version here [Ollama](https://github.com/ollama/ollama/releases/tag/v0.1.26)\n",
@@ -84,7 +85,8 @@
"metadata": {},
"outputs": [],
"source": [
- "llm = Ollama(model=\"gemma\", request_timeout=30.0)"
+ "gemma_2b = Ollama(model=\"gemma:2b\", request_timeout=30.0)\n",
+ "gemma_7b = Ollama(model=\"gemma:7b\", request_timeout=30.0)"
]
},
{
@@ -92,50 +94,63 @@
"execution_count": null,
"id": "d61b10bb-e911-47fb-8e84-19828cf224be",
"metadata": {},
- "outputs": [],
+ "outputs": [
+ {
+ "name": "stdout",
+ "output_type": "stream",
+ "text": [
+ "Paul Graham is an entrepreneur, investor, and podcaster known for his outspokenness and unconventional approach. He has built several successful companies, including Xero (now Intuit), FullStory, and The School of Greatness.\n",
+ "\n",
+ "Here are some of his notable achievements:\n",
+ "\n",
+ "* **Founder and CEO of Xero:** Xero is a leading accounting software company for small and medium-sized businesses, with over 1 million users worldwide. Graham was instrumental in Xero's rapid growth and eventual acquisition by Intuit (now part of Microsoft) for $750 million in 2015.\n",
+ "* **Author of several bestselling books:** Graham is the author of the book \"The School of Greatness,\" which focuses on personal development and productivity. He also co-authored \"Built to Last: Why Your Business Matters\" with his former Xero partner, Steve Huffman.\n",
+ "* **Founder of The School of Greatness:** The School of Greatness is a non-profit organization that offers mentoring, workshops, and retreats to help entrepreneurs and business leaders reach their full potential.\n",
+ "* **Podcast host and guest speaker:** Graham is the host of the popular podcast \"Bits,\" where he interviews influential entrepreneurs and thought leaders. He is also a frequent guest on other podcasts and shows.\n",
+ "\n",
+ "Here are some additional facts about Paul Graham:\n",
+ "\n",
+ "* He is known for his unorthodox and often controversial approach to business and life.\n",
+ "* He is considered by many to be one of the most influential entrepreneurs and thought leaders in Australia.\n",
+ "* He is also a passionate advocate for personal growth and development, and he regularly shares tips and insights on his podcast and social media platforms.\n",
+ "\n",
+ "If you'd like to learn more about Paul Graham and his businesses, you can check out his website (paulfgraham.com), the School of Greatness website (theschoolofgreatness.org), and his podcast website (bitspodcast.com).\n"
+ ]
+ }
+ ],
"source": [
- "resp = llm.complete(\"Who is Paul Graham?\")"
+ "resp = gemma_2b.complete(\"Who is Paul Graham?\")\n",
+ "print(resp)"
]
},
{
"cell_type": "code",
"execution_count": null,
- "id": "3bd14f4e-c245-4384-a471-97e4ddfcb40e",
+ "id": "c0384655",
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
- "Paul Graham is an entrepreneur, investor, and podcaster who has built successful businesses in software, online communities, and healthcare.\n",
- "\n",
- "**Key Highlights:**\n",
+ "Paul Graham (born February 21, about 45 years old) has achieved significant success as a software developer and entrepreneur. He's known for his insightful writing on Software Engineering at greaseboxsoftware where he frequently writes articles with humorous yet pragmatic advice regarding programming languages such Python while occasionally offering tips involving general life philosophies that resonate deeply amongst the programmer community, particularly about work ethic (\"hacker mentality\") He has contributed to software engineering communities in a multitude of ways:\n",
"\n",
- "* Co-founder and CEO of SpaceX, a space exploration company.\n",
- "* Founder and CEO of GV, a venture capital firm that invests in early-stage companies.\n",
- "* Co-host of the popular podcast \"The Graham Graham Show\".\n",
- "* Author of the book \"Start with Why: How to Build a Business Around Your Values\".\n",
- "* Known for his ambitious vision, deep industry knowledge, and commitment to excellence.\n",
+ "**Developer:**\n",
+ "* Created Bulletphysics (a physics engine for games) using PyTorch. He resigned from his day job as Lead Software Engineer at Aversim Technologies after successfully building it and expriming its potential, showcasing the powerfull nature this open-source project has achieved within software engineering circles with significant media coverage involving top professionals expressing admiration\n",
+ "* Wrote Bulletphysics Gamma Ray Field Solver for Beam Interactive LLC to provide solutions in areas of physics where general relativity meets soft body simulation.\n",
"\n",
- "**Accomplishments:**\n",
+ "**Author:** He is a prolific author on Software Engineering and writes about his work, challenges encountered while building complex systems software engineering (\"hacker mentality\") with honesty but wiense humour\n",
+ "* Shared code snippets frequently as explanations are concise yet insightful for specific situations involving particular language constructs or solutions to common problems faced by programmers.\n",
"\n",
- "* SpaceX has achieved numerous milestones in space exploration, including the launch of the Falcon Heavy rocket, which will revolutionize transportation.\n",
- "* GV has made significant investments in successful companies such as Airbnb, Spotify, and Riot Games.\n",
- "* Received numerous awards and honors, including recognition from Forbes, Fortune, and The New York Times.\n",
+ "**Thought Leader:** He has become a significant thought leader in the programmer community due his writing and public appearances, particularly about software engineering best practices while maintaining an approachable persona that encourages learning from others\n",
+ "* Actively engaged with online forums where he frequently provides advice for aspiring developers as well insightful solutions to complex problems encountered by experienced programmers.\n",
"\n",
- "**Personal Life:**\n",
- "\n",
- "* Born in Oakland, California.\n",
- "* Married with four children.\n",
- "* Interests include space exploration, technology, and healthcare.\n",
- "\n",
- "**Philosophy:**\n",
- "\n",
- "Graham's philosophy emphasizes the importance of identifying a clear purpose in life and aligning one's career with their values. He also believes that creating compelling communities and fostering innovation are essential for driving progress.\n"
+ "Overall Paul Graham has achieved a significant impact on Software Engineering through not only his own accomplishments but also the positive influence of sharing information, helping other software engineers become better at their craft and fuftage potential in this field with gracefull writing style that is enjoyed amongst professionals as well privetiors alike\n"
]
}
],
"source": [
+ "resp = gemma_7b.complete(\"Who is Paul Graham?\")\n",
"print(resp)"
]
},
@@ -144,26 +159,36 @@
"execution_count": null,
"id": "5712a813",
"metadata": {},
- "outputs": [],
+ "outputs": [
+ {
+ "name": "stdout",
+ "output_type": "stream",
+ "text": [
+ "Tesla Inc. is owned by Elon Musk. He founded Tesla in 2003 with the goal of creating sustainable transportation. Tesla was originally listed on the NASDAQ Stock Market under the symbol \"TSLA\". In 2013, Tesla went private and began trading on the New York Stock Exchange (NYSE).\n"
+ ]
+ }
+ ],
"source": [
- "resp = llm.complete(\"Who is owning Tesla?\")"
+ "resp = gemma_2b.complete(\"Who is owning Tesla?\")\n",
+ "print(resp)"
]
},
{
"cell_type": "code",
"execution_count": null,
- "id": "75da49db",
+ "id": "91fe8b00",
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
- "Tesla, Inc. is a privately held electric vehicle manufacturer headquartered in Palo Alto, California. Elon Musk is the CEO and lead designer of Tesla.\n"
+ "Elon Musk, CEO of SpaceX and former electric car company Telsa Motors (now part owned by Ford Motor Company), owns about a quarter to nearly half the stock in TESLA inc.\n"
]
}
],
"source": [
+ "resp = gemma_7b.complete(\"Who is owning Tesla?\")\n",
"print(resp)"
]
},
@@ -191,7 +216,7 @@
" ),\n",
" ChatMessage(role=\"user\", content=\"What is your name\"),\n",
"]\n",
- "resp = llm.chat(messages)"
+ "resp = gemma_7b.chat(messages)"
]
},
{
@@ -204,7 +229,7 @@
"name": "stdout",
"output_type": "stream",
"text": [
- "assistant: Ahoy, matey! My name be Captain Calico Meow Meow, and I'd prefer to hoist a kraken flag and plunder some adventure!\n"
+ "assistant: Avast, me heartie. My Name be Jolly Roger and I plunder the high seas for treasures untold!\n"
]
}
],
@@ -237,7 +262,7 @@
"metadata": {},
"outputs": [],
"source": [
- "response = llm.stream_complete(\"Who is Paul Graham?\")"
+ "response = gemma_7b.stream_complete(\"Who is Paul Graham?\")"
]
},
{
@@ -250,7 +275,14 @@
"name": "stdout",
"output_type": "stream",
"text": [
- "Paul Graham is a software engineer and entrepreneur who founded Y Combinator, a venture capital firm that invests in early-stage companies. He is also the co-author of the book \"How to Build the Future: What The Tech Revolution Is Doing to Society\"."
+ "Paul graham, commonly referred to as \"PerlGuy\" online has a significant presence in the software engineering and programming communities. He specializes primarily on:\n",
+ "\n",
+ "**1.) Software Design:** * Shared his ideas about effective coding patterns for Modularization (DRY) into books like Expert Refactoring using Smells And Polymorphism Principle(SRPPP).\n",
+ " * Has written extensively, sharing best practices to improve code quality while reducing coupling between software modules and layers. This has influenced numerous developers worldwide in writing better Software Design Patterns with Low Coupling Designs Epidra Hard To Measure Modularity (SOLID) principles at heart for projects ranging from mobile apps all the way up into enterprise systems\n",
+ "**2.) Open Source:** * Actively contributed to Project Lombok, Phalanger(now Relocator), and CouchSurfer. Shared his code design patterns on fufurce with significant impact as well . He has earned recognition by maintaining high quality open source software projects while being part of multiple top rated organizations like Pivotal Software Systems\n",
+ "**3.) Coaching:** * Offers coaching services to businesses, helping them improve their engineering practices and writing better testable Code. Shared his expertise on Design patterns during training sessions for large audiences as well .\n",
+ "\n",
+ "Overall Paul Graham has earned significant credibility by sharing best software designPractices while being part of open source projects where he advocates high quality code solutions that are easy Measure Epidra Hard To cras Low Modularity (SOLID)principles into production systems, ensuring long term sustainability."
]
}
],
@@ -283,7 +315,7 @@
" ),\n",
" ChatMessage(role=\"user\", content=\"What is your name\"),\n",
"]\n",
- "resp = llm.stream_chat(messages)"
+ "resp = gemma_7b.stream_chat(messages)"
]
},
{
@@ -296,7 +328,7 @@
"name": "stdout",
"output_type": "stream",
"text": [
- "Avast, me shipmate! I be Captain Bartholomew Blisterbeard, known far and wide for my wit and swagger. And let me tell ye, me beard ain't as white as the purest moonlight on a summer night!"
+ "Avast, me heartie! My alias be Screevy Bob. If you ask for my real nom de guerre... I ain't tellin'. Arrgh and all that jazz!!"
]
}
],