Software Engineer (AI & Python Development)

Job Title: Software Engineer (AI & Python Development)

We are looking for an Software Engineer (AI & IT-Python Development) to join our growing AI team and help build, scale, and maintain the backend infrastructure powering our unified AI platforms. The ideal candidate has a solid foundation in backend engineering, a working knowledge of AI/ML systems, and the drive to experiment and ship real products.

Key Responsibilities:

• Design and maintain a unified LLM gateway that integrates multiple AI providers (OpenAI, Anthropic Claude, Google Gemini, and others) under a single API layer
• Manage authentication, API key lifecycle, and multi-tenant access control for platform users
• Optimize response streaming from LLM providers to deliver low-latency, real-time chat experiences
• Run pre-trained model experiments for question-answering or semantic search.
• Monitor backend performance, debug production issues, and improve system observability with logging and alerting
• Stay up to date with new AI model releases and evaluate integrations into the platform

Requirements:

Education:

Bachelor’s degree in Computer Science, Information Technology, or a related field. Exceptional will be considered.

Experience:

• Familiarity with pre-trained NLP models (Sentence Transformers, Mistral, MiniLM, T5, LLaMA, Gemma).
• Knowledge of Fast API, API Gateway Must, Hybrid caching.
• Knowledge of Git, Docker.
• Knowledge on LiteLLM, Langchain, Autogen

Required Skills:

• Knowledge of Python, Kong Gateway, Redis caching, Lang cache
• Familiarity with machine learning / NLP concepts: embeddings, semantic search, similarity.
• Knowledge of data preprocessing: Pandas, NumPy.
• Strong attention to detail and willingness to learn.
• Familiarity with Git, Docker.

Additional Requirements:

• Strong communication skills in English (both written and spoken).
• Proactive problem-solver with excellent collaboration skills.
• Ability to work in a fast-paced, agile environment.

Compensation & Benefits:

• Weekly Holidays: 2 days/week (Friday & Saturday)
• Salary Review: Annually
• Festival Bonuses: 2 per year
• Leave Entitlement: Sick Leave & Annual Leave
• Performance Recognition: Yearly Awards Based on Performance
• Work Environment: 3 offices Premises, Friendly, collaborative, and supportive
• Office Location: Panthopath, Dhaka.

Others Benefits:

• Skill development and learning support (online courses, workshops)
• Employee wellness support and periodic team outings
• Opportunity to work on global digital products
• Career advancement within Gakk Media ltd and its sister companies