AI Infrastructure Engineer (GPU) - Remote EMEA
pragmatike
Job description
About the role
A fast-scaling, well-funded distributed cloud infrastructure startup is looking for an AI Infrastructure Engineer with strong experience in production-grade model serving and infrastructure for AI systems. The company provides GPU-powered infrastructure for AI/ML workloads, secure storage and high-speed data transfer through a decentralized architecture. The role is fully remote (EMEA timezone), starts ASAP, requires fluent English and sits in the cloud computing / AI / European deep-tech SaaS space.
Key responsibilities
- Build and operate production-grade model serving infrastructure using frameworks such as vLLM, TGI, Triton or equivalent
- Design and implement deployment pipelines with blue/green and canary rollout strategies for ML models
- Develop auto-scaling systems, multi-model serving architectures and intelligent request routing layers
- Optimize GPU utilization, memory efficiency, network throughput and model artifact storage performance
- Design observability systems for inference latency, throughput, GPU usage, cost metrics and system health
- Manage model registries and CI/CD pipelines for automated, reproducible model deployments
- Own the full lifecycle of ML systems, including operational support and on-call duties
- Define engineering best practices and help scale the platform in a fast-moving startup
Required profile
- 4+ years of experience in ML Ops, Platform Engineering, SRE or similar roles focused on ML systems
- Strong background in container orchestration and running GPU-based workloads in production
- Experience with MLOps tooling: model registries, experiment tracking and automated deployment pipelines
- Strong understanding of distributed systems, performance tuning and production reliability engineering
- Ability to use AI coding assistants and to work independently in a remote-first environment
Required skills
- Model serving frameworks: vLLM, TGI, Triton or equivalent
- Python and infrastructure-as-code tools such as Terraform or Helm
- Container orchestration
Preferred: Kubeflow, MLflow or KubeAI; GPU scheduling, CUDA/ROCm optimization or multi-tenant inference; cost optimization across GPU types; early-stage startup or greenfield project background; building production systems from scratch.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Україна.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
Une question sur cette offre ?
Posez-la ici : vous recevrez le récapitulatif de l'offre par e-mail, tout de suite.
Published 2 тижні тому
Expires за 1 місяць
25 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
pragmatike