Sr. Software Engineer (AI & LLM Integration)

  • Full-time

Company Description

We are a leading-edge technology consulting firm committed to empowering organizations through the implementation of cloud-native and enterprise DevSecOps transformations. Our team of dedicated experts is driven by a passion for harnessing cutting-edge technologies to deliver unparalleled value to our clients. We specialize in crafting innovative technical solutions grounded in cloud-native principles, containerization, and the implementation of advanced automation-driven DevSecOps practices.

At the heart of our ethos lies a relentless pursuit of progress and the establishment of new industry benchmarks. Our unwavering commitment to excellence sets us apart and makes us the preferred choice for our clients. We recognize that delivering exceptional technical solutions necessitates the expertise of renowned professionals.

If you share our zeal for constructing cloud-native systems, developing cloud-based applications, and designing automation solutions, and if you are seeking to join a company that stands as a dominant force in the realms of Enterprise DevSecOps and Cloud Native domains, then you've discovered the ideal destination.

We cultivate a vibrant, inclusive, and collaborative environment that champions innovation and continuous learning. As a member of our team, you will have the opportunity to engage in exciting projects, tackle intricate challenges, and make a substantial contribution to the advancement of digital transformation for our clients. Come and be a part of a team that thrives on pushing the boundaries of what technology can achieve.

Job Description

We are seeking a highly skilled Sr. Software Engineer (AI & LLM Integration) with expertise in Python and Node.js, AI model integration, and data engineering. The ideal candidate has experience building AI-driven applications, integrating Large Language Models (LLMs), and working with scalable backend architectures.


Key Responsibilities:

  • Design and develop AI-driven applications that integrate LLMs for real-world use cases.
  • Architect, implement, and optimize APIs for efficient model interaction and deployment.
  • Develop and maintain AI-powered backend systems using Python and Node.js.
  • Work with vector databases (e.g., Pinecone, FAISS, Weaviate) to build intelligent search and retrieval capabilities.
  • Optimize model performance by fine-tuning LLMs and improving inference efficiency.
  • Leverage cloud platforms (AWS, GCP, Azure) to deploy and manage AI applications at scale.
  • Build and maintain data pipelines for feeding structured and unstructured data into AI models.
  • Ensure security, scalability, and efficiency in AI-driven applications.
  • Collaborate with cross-functional teams, including data engineers, UI/UX designers, and DevSecOps experts, to integrate AI solutions seamlessly.
  • Write clean, maintainable, and well-documented code following best practices in software development.

Qualifications

Must-Have Skills:

  • 5-7 years of experience in software development using Python and Node.js.
  • Strong experience with AI/ML frameworks (e.g., OpenAI, Hugging Face, TensorFlow, PyTorch, LangChain).
  • Experience integrating LLM APIs (OpenAI, Anthropic, Mistral, Cohere, etc.).
  • Deep understanding of RESTful APIs and WebSockets for AI-powered applications.
  • Hands-on experience with vector databases (e.g., Pinecone, FAISS, Weaviate) and knowledge retrieval techniques.
  • Proficiency in designing data workflows, including ETL processes, structured/unstructured data processing, and AI model training pipelines.
  • Cloud computing expertise (AWS, GCP, or Azure) and familiarity with containerization (Docker, Kubernetes).
  • Experience with CI/CD pipelines (GitHub Actions, GitLab CI/CD, Jenkins).
  • Strong problem-solving skills and the ability to work in a fast-paced, iterative development environment.

Nice-to-Have Skills:

  • Familiarity with distributed data processing frameworks (e.g., Apache-based technologies such as Spark, Kafka, or Flink).
  • Experience working with AWS data services (Athena, Glue, or related).
  • Experience in query optimization and large-scale data processing for AI applications.
  • Exposure to data lake architectures and cloud-based analytics solutions.
  • Prior experience in fine-tuning or deploying LLMs in hybrid cloud environments.

Additional Information

We Value:

  • Drive: Passion and energy to implement quality technical solutions. Self-motivation and intellectual curiosity
  • Commitment to Quality: Passion to conceive and produce world-class solutions that drive real-world value for the customer
  • Customer Focus: Consultative approach to solving problems for customers. Expectations management.
  • Communication: Superior communication skills. Ability to clearly articulate problems, solutions, risks, rewards etc. (written and verbal)
  • Technical Skills: Love for technology. You have to be inherently passionate about technology.
  • Business Acumen: Technology ultimately is used to enable the business. We look for people who understand how the businesses can be enabled through their technical solutions

What we offer:

  • Ability to make a noticeable difference for the organization and our customers
  • Tremendous growth opportunity by becoming part of a rapidly growing organization. It’s not your tenure but what you can bring to the table that defines how your career will be shaped. You control your growth.
  • Complex but interesting challenges to improve the depth and breadth of your technical and business skills. Our consultants are business technologists and understand how technology drives business. 
  • Competitive pay and benefits

Oteemo is an equal employment and affirmative action employer. We evaluate qualified applicants on merit and business needs and not on race, color, religion, creed, gender, sexual orientation, national origin, ancestry, age, disability, genetic information, marital status, veteran status or any other factor protected by law. Oteemo complies with the law regarding reasonable accommodations for handicapped and disabled employees.