Post
118
π’ If you're aimed at quick experiment with LLM and known Chain-of-Thought (CoT) / prompt schema with no-string dependencies, then I have something relevant for you to share π
So far I released the updated version π¦ bulk-chain-0.25.0 π¦, which is aimed at bringing accessible API for an instant LLM application towards massive data iterators using via predefined prompt schema π
π¦: https://pypi.org/project/bulk-chain/0.25.0/
π: https://github.com/nicolay-r/bulk-chain
π: https://github.com/nicolay-r/bulk-chain/issues/26
The key updates of the most recent release are:
β πͺΆ No-string (empty dependencies): you can use any framework / API for LLM.
β π Python API support (see first screenshot πΈ).
β π₯ Native try-catch wrapping to guarantee no-data-lost on using remote providers especially: OpenAI, ReplicateIO, OpenRouter, etc.
β π₯ Batching mode support: you may wrap for handling batches to significantly boost the performance π (see screenshot below for bath enabling πΈ)
β π§ Fixed a lot of minor bugs
Quick start on GoogleColab:
π: https://colab.research.google.com/github/nicolay-r/bulk-chain/blob/master/bulk_chain_tutorial.ipynb
π The wiki of the project is available here:
https://github.com/nicolay-r/bulk-chain/wiki/Project-Documentation
So far I released the updated version π¦ bulk-chain-0.25.0 π¦, which is aimed at bringing accessible API for an instant LLM application towards massive data iterators using via predefined prompt schema π
π¦: https://pypi.org/project/bulk-chain/0.25.0/
π: https://github.com/nicolay-r/bulk-chain
π: https://github.com/nicolay-r/bulk-chain/issues/26
The key updates of the most recent release are:
β πͺΆ No-string (empty dependencies): you can use any framework / API for LLM.
β π Python API support (see first screenshot πΈ).
β π₯ Native try-catch wrapping to guarantee no-data-lost on using remote providers especially: OpenAI, ReplicateIO, OpenRouter, etc.
β π₯ Batching mode support: you may wrap for handling batches to significantly boost the performance π (see screenshot below for bath enabling πΈ)
β π§ Fixed a lot of minor bugs
Quick start on GoogleColab:
π: https://colab.research.google.com/github/nicolay-r/bulk-chain/blob/master/bulk_chain_tutorial.ipynb
π The wiki of the project is available here:
https://github.com/nicolay-r/bulk-chain/wiki/Project-Documentation