AI Platform Architect - Anthropic
Full-time
NewRocket
Responsibilities
- Design, build, deploy, and maintain reusable platform capabilities, reference architectures, deployment templates, integration components, and engineering standards for enterprise AI.
- Build secure integrations with the Anthropic API, Claude models, enterprise APIs, data sources, workflow systems, and authorized tools.
- Establish CI/CD, versioning, testing, evaluation, release, rollback, monitoring, incident-response, and lifecycle-management capabilities for AI applications and infrastructure.
- Design and manage cloud infrastructure, infrastructure-as-code, containerized deployments, identity and access controls, secrets management, logging, monitoring, auditing, and disaster-recovery practices.
- Build secure data-ingestion, transformation, indexing, retrieval, RAG, vector-search, and enterprise data-access patterns.
- Implement responsible-AI safeguards, governance controls, observability, tracing, output validation, human-in-the-loop workflows, and auditability.
- Develop integrations with ServiceNow, identity providers, workflow tools, collaboration platforms, and line-of-business systems.
- Provide technical guidance, documentation, playbooks, architecture reviews, customer workshops, and reusable platform components across AI, data, product, and delivery teams.
Requirements
- At least 5 years of experience in platform engineering, cloud engineering, DevOps, software engineering, data engineering, systems integration, or related technical roles.
- Hands-on experience designing and deploying cloud-native applications on AWS, Microsoft Azure, and/or Google Cloud Platform.
- Strong experience with CI/CD, Git-based workflows, automated testing, infrastructure as code, and production release processes.
- Experience with Docker, Kubernetes, serverless services, or comparable cloud-native platforms.
- Proficiency in Python, JavaScript/TypeScript, Java, Go, Bash, or similar programming and scripting languages.
- Experience designing and consuming REST APIs and implementing authentication and authorization patterns.
- Hands-on experience with LLM-powered applications, generative AI services, AI/ML platforms, RAG systems, or AI workflow automation.
- Familiarity with prompt and context engineering, token management, embeddings, vector search, structured outputs, tool use or function calling, evaluations, and model monitoring.
- Experience with logging, metrics, tracing, alerting, incident management, cloud security, identity and access management, secrets management, network security, and secure software development.
- Experience with relational and NoSQL databases, data warehouses, object storage, search platforms, or vector databases.
- Strong problem-solving, troubleshooting, communication, and documentation skills, with the ability to work in collaborative customer-oriented environments.
- Preferred qualifications include Claude or Anthropic API experience, MCP, LLM application frameworks, LLM evaluation and observability, MLOps, data engineering, vector databases, Kubernetes operations, cloud-cost optimization, ServiceNow, consulting, enterprise architecture, or client-facing technical delivery.
- A bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, or a related technical discipline is preferred; relevant certifications and equivalent professional experience are also considered.
Benefits
- The role offers a location arrangement described as location/hybrid/remote, with travel based on client and business needs.
- NewRocket describes a diverse and inclusive workplace and is an equal opportunity and affirmative action employer.
- Work includes collaboration with Anthropic, AI Foundry, ServiceNow, product engineering, data engineering, and enterprise client teams.
Vacancy posted 5 days ago