SymbolicAI: A neuro-symbolic perspective on LLMs What is SymbolicAI? SymbolicAI is a neuro-symbolic framework, combining classical Python programming with the differentiable, programmable nature of LLMs in a way that actually feels natural in Python. It's built to not stand in the way of your ambitions. It's easily extensible and customizable to your needs by virtue of its modular design. It's quite easy to write your own engine, host locally an engine of your choice, or interface with tools like web search or image generation. To keep things concise in this README, we'll introduce two key concepts that define SymbolicAI: primitives and contracts. Primitives At the core of SymbolicAI are Symbol objects—each one comes with a set of tiny, composable operations that feel like native Python. from symai import Symbol Symbol comes in two flavours: Syntactic – behaves like a normal Python value (string, list, int ‐ whatever you passed in). Semantic – is wired to the neuro-symbolic engine and therefore understands meaning and context. Why is syntactic the default? Because Python operators ( == , ~ , & , …) are overloaded in symai . If we would immediately fire the engine for every bitshift or comparison, code would be slow and could produce surprising side-effects. Starting syntactic keeps things safe and fast; you opt-in to semantics only where you need them. How to switch to the semantic view At creation time S = Symbol ( "Cats are adorable" , semantic = True ) # already semantic print ( "feline" in S ) # => True On demand with the .sem projection – the twin .syn flips you back: S = Symbol ( "Cats are adorable" ) # default = syntactic print ( "feline" in S . sem ) # => True print ( "feline" in S ) # => False Invoking dot-notation operations—such as .map() or any other semantic function—automatically switches the symbol to semantic mode: S = Symbol ([ 'apple' , 'banana' , 'cherry' , 'cat' , 'dog' ]) print ( S . map ( 'convert all fruits to vegetables' )) # => ['carrot', 'broccoli', 'spinach', 'cat', 'dog'] Because the projections return the same underlying object with just a different behavioural coat, you can weave complex chains of syntactic and semantic operations on a single symbol. Think of them as your building blocks for semantic reasoning. Right now, we support a wide range of primitives; check out the docs here, but here's a quick snack: Primitive/Operator Category Syntactic Semantic Description == Comparison ✓ ✓ Tests for equality. Syntactic: literal match. Semantic: fuzzy/conceptual equivalence (e.g. 'Hi' == 'Hello'). + Arithmetic ✓ ✓ Syntactic: numeric/string/list addition. Semantic: meaningful composition, blending, or conceptual merge. & Logical/Bitwise ✓ ✓ Syntactic: bitwise/logical AND. Semantic: logical conjunction, inference, e.g., context merge. symbol[index] = value Iteration ✓ ✓ Set item or slice. .startswith(prefix) String Helper ✓ ✓ Check if a string starts with given prefix (in both modes). .choice(cases, default) Pattern Matching ✓ Select best match from provided cases. .foreach(condition, apply) Execution Control ✓ Apply action to each element. .cluster(**clustering_kwargs?) Data Clustering ✓ Cluster data into groups semantically. (uses sklearn's DBSCAN) .similarity(other, metric?, normalize?) Embedding ✓ Compute similarity between embeddings. ... ... ... ... ... Contracts They say LLMs hallucinate—but your code can't afford to. That's why SymbolicAI brings Design by Contract principles into the world of LLMs. Instead of relying solely on post-hoc testing, contracts help build correctness directly into your design, everything packed into a decorator that will operate on your defined data models and validation constraints: from symai import Expression from symai . strategy import contract from symai . models import LLMDataModel # Compatible with Pydantic's BaseModel from pydantic import Field , field_validator # ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ # Data models ▬ # – clear structure + rich Field descriptions power ▬ # validation, automatic prompt templating & remedies ▬ # ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ class DataModel ( LLMDataModel ): some_field : some_type = Field ( description = "very descriptive field" , and_other_supported_options_here = "..." ) @ field_validator ( 'some_field' ) def validate_some_field ( cls , v ): # Custom basic validation logic can be added here too besides pre/post valid_opts = [ 'A' , 'B' , 'C' ] if v not in valid_sizes : raise ValueError ( f'Must be one of { valid_sizes } , got " { v } ".' ) return v # ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ # 2. The contracted expression class ▬ # ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ @ contract ( # ── Remedies ─────────────────────────────────────────── # pre_remedy = True , # Try to fix bad inputs automatically post_remedy = True , # Try to fix bad LLM outputs automatically accumulate_errors = True , # Feed history of errors to each retry verbose = True , # Nicely displays progress in terminal remedy_retry_params = dict ( tries = 3 , delay = 0.4 , max_delay = 4.0 , jitter = 0.15 , backoff = 1.8 , graceful = False ), ) class Agent ( Expression ): # # High-level behaviour: # *. `prompt` – a *static* description of what the LLM must do (mandatory) # 1. `pre` – sanity-check inputs (optional) # 2. `act` – mutate state (optional) # 3. LLM – generate expected answer (handled by SymbolicAI engine) # 4. `post` – ensure answer meets semantic rules (optional) # 5. `forward` (mandatory) # • if contract succeeded → return type validated LLM object # • else → graceful fallback answer # ... Because we don't want to bloat this README file with long Python snippets, learn more about contracts here and here. Installation Core Features To get started with SymbolicAI, you can install it using pip: pip install symbolicai Setting up a neurosymbolic API Key Before using SymbolicAI, you need to set up API keys for the various engines. Currently, SymbolicAI supports the following neurosymbolic engines through API: OpenAI, Anthropic. We also support {doc} local neurosymbolic engines , such as llama.cpp and huggingface. # Linux / MacOS export NEUROSYMBOLIC_ENGINE_API_KEY= " … " export NEUROSYMBOLIC_ENGINE_MODEL= " … " # Windows (PowerShell) $Env :NEUROSYMBOLIC_ENGINE_API_KEY= " … " $Env :NEUROSYMBOLIC_ENGINE_MODEL= " … " # Jupyter Notebooks %env NEUROSYMBOLIC_ENGINE_API_KEY=… %env NEUROSYMBOLIC_ENGINE_MODEL=… Optional Features SymbolicAI uses multiple engines to process text, speech and images. We also include search engine access to retrieve information from the web. To use all of them, you will need to also install the following dependencies and assign the API keys to the respective engines. pip install " symbolicai[wolframalpha] " pip install " symbolicai[whisper] " pip install " symbolicai[selenium] " pip install " symbolicai[serpapi] " pip install " symbolicai[pinecone] " Or, install all optional dependencies at once: pip install " symbolicai[all] " And export the API keys, for example: # Linux / MacOS export SYMBOLIC_ENGINE_API_KEY= " " export SEARCH_ENGINE_API_KEY= " " export OCR_ENGINE_API_KEY= " " export INDEXING_ENGINE_API_KEY= " " # Windows (PowerShell) $Env :SYMBOLIC_ENGINE_API_KEY= " " $Env :SEARCH_ENGINE_API_KEY= " " $Env :OCR_ENGINE_API_KEY= " " $Env :INDEXING_ENGINE_API_KEY= " " See below for the entire list of keys that can be set via environment variables or a configuration file. Additional Requirements SpeechToText Engine: Install ffmpeg for audio processing (based on OpenAI's whisper) # Linux sudo apt update && sudo apt install ffmpeg # MacOS brew install ffmpeg # Windows choco install ffmpeg WebCrawler Engine: For selenium , we automatically install the driver with chromedriver-autoinstaller . Currently we only support Chrome as the default browser. Configuration Management SymbolicAI now features a configuration management system with priority-based loading. The configuration system looks for settings in three different locations, in order of priority: Debug Mode (Current Working Directory) Highest priority Only applies to symai.config.json Useful for development and testing Environment-Specific Config (Python Environment) Second priority Located in {python_env}/.symai/ Ideal for project-specific settings Global Config (Home Directory) Lowest priority Located in ~/.symai/ Default fallback for all settings Configuration Files The system manages three main configuration files: symai.config.json : Main SymbolicAI configuration : Main SymbolicAI configuration symsh.config.json : Shell configuration : Shell configuration symserver.config.json : Server configuration Viewing Your Configuration Before using the package, we recommend inspecting your current configuration setup using the command below. This will create all the necessary configuration files. symconfig This command will show: All configuration locations Active configuration paths Current settings (with sensitive data truncated) Configuration Priority Example my_project/ # Debug mode (highest priority) └── symai.config.json # Only this file is checked in debug mode {python_env}/.symai/ # Environment config (second priority) ├── symai.config.json ├── symsh.config.json └── symserver.config.json ~/.symai/ # Global config (lowest priority) ├── symai.config.json ├── symsh.config.json └── symserver.config.json If a configuration file exists in multiple locations, the system will use the highest-priority version. If the environment-specific configuration is missing or invalid, the system will automatically fall back to the global configuration in the home directory. Best Practices Use the global config ( ~/.symai/ ) for your default settings ) for your default settings Use environment-specific configs for project-specific settings Use debug mode (current directory) for development and testing Run symconfig to inspect your current configuration setup This addition to the README clearly explains: The priority-based configuration system The different configuration locations and their purposes How to view and manage configurations Best practices for configuration management Configuration File You can specify engine properties in a symai.config.json file in your project path. This will replace the environment variables. Example of a configuration file with all engines enabled: { "NEUROSYMBOLIC_ENGINE_API_KEY" : " " , "NEUROSYMBOLIC_ENGINE_MODEL" : " gpt-4o " , "SYMBOLIC_ENGINE_API_KEY" : " " , "SYMBOLIC_ENGINE" : " wolframalpha " , "EMBEDDING_ENGINE_API_KEY" : " " , "EMBEDDING_ENGINE_MODEL" : " text-embedding-3-small " , "SEARCH_ENGINE_API_KEY" : " " , "SEARCH_ENGINE_MODEL" : " sonar " , "TEXT_TO_SPEECH_ENGINE_API_KEY" : " " , "TEXT_TO_SPEECH_ENGINE_MODEL" : " tts-1 " , "INDEXING_ENGINE_API_KEY" : " " , "INDEXING_ENGINE_ENVIRONMENT" : " us-west1-gcp " , "DRAWING_ENGINE_API_KEY" : " " , "DRAWING_ENGINE_MODEL" : " dall-e-3 " , "VISION_ENGINE_MODEL" : " openai/clip-vit-base-patch32 " , "OCR_ENGINE_API_KEY" : " " , "SPEECH_TO_TEXT_ENGINE_MODEL" : " turbo " , "SUPPORT_COMMUNITY" : true } With these steps completed, you should be ready to start using SymbolicAI in your projects. ❗️NOTE❗️Our framework allows you to support us train models for local usage by enabling the data collection feature. On application startup we show the terms of services and you can activate or disable this community feature. We do not share or sell your data to 3rd parties and only use the data for research purposes and to improve your user experience. To change this setting open the symai.config.json and turn it on/off by setting the SUPPORT_COMMUNITY property to True/False via the config file or the respective environment variable. ❗️NOTE❗️By default, the user warnings are enabled. To disable them, export SYMAI_WARNINGS=0 in your environment variables. Running tests Some examples of running tests locally: # Run all tests pytest tests # Run mandatory tests pytest -m mandatory Be sure to have your configuration set up correctly before running the tests. You can also run the tests with coverage to see how much of the code is covered by tests: pytest --cov=symbolicai tests 🪜 Next Steps Now, there are tools like DeepWiki that provide better documentation than we could ever write, and we don’t want to compete with that; we'll correct it where it's plain wrong. Please go read SymbolicAI's DeepWiki page. There's a lot of interesting stuff in there. Last but not least, check out our paper that describes the framework in detail. If you like watching videos, we have a series of tutorials that you can find here. 📜 Citation @software { Dinu_SymbolicAI_2022 , author = { Dinu, Marius-Constantin } , editor = { Leoveanu-Condrei, Claudiu } , title = { {SymbolicAI: A Neuro-Symbolic Perspective on Large Language Models (LLMs)} } , url = { https://github.com/ExtensityAI/symbolicai } , month = { 11 } , year = { 2022 } } 📝 License This project is licensed under the BSD-3-Clause License - refer to the docs. Like this Project? If you appreciate this project, please leave a star ⭐️ and share it with friends and colleagues. To support the ongoing development of this project even further, consider donating. Thank you! We are also seeking contributors or investors to help grow and support this project. If you are interested, please reach out to us. 📫 Contact Feel free to contact us with any questions about this project via email, through our website, or find us on Discord: