Remote (India)
12 PM - 8 PM IST
Contract: 2 Years
Onboarding: Immediate
About BLS360
BLS360 is a fast-growing cybersecurity, identity & access management (IAM), and digital transformation company, helping enterprises secure and modernize their technology landscape. Founded in 2019, BLS360 delivers scalable, secure, and customized solutions across industries including finance, healthcare, and government.
With strong partnerships across leading cloud and identity platforms, BLS360 focuses on identity-centric security, compliance, and next-gen digital innovation, enabling organizations to navigate complex, multi-cloud environments with confidence.
Role Overview
We're looking for a Senior AI QA / QE Engineer to lead quality engineering efforts for cutting-edge AI-powered applications. This role is ideal for someone who thrives at the intersection of QA, automation, and AI systems, and can ensure reliability in complex, non-deterministic environments.
What You'll Do
Lead QA strategy and execution for AI-driven applications and systemsBuild and maintain automated test frameworks (Python, Robot Framework) across APIs, UI, backend, and data pipelinesIntegrate automated tests into CI/CD pipelinesPerform functional, performance, and exploratory testingValidate AI/LLM outputs using structured and non-deterministic testing approachesConduct prompt testing and evaluate LLM behavior (PromptFoo experience preferred)Test and validate RAG-based systems, including ground truth evaluationCollaborate with engineering and product teams to define quality benchmarksDebug complex issues, including AI/LLM-specific challengesMust-Have Skills
Strong experience in QA automation and test strategyHands-on experience testing AI/LLM-powered applications and agentsExpertise in non-deterministic output validation and ground truth comparisonExperience with RAG testing and validationProficiency in Python-based automation frameworksSolid understanding of defect analysis and system debuggingExperience working in Agile environments with tools like JiraTest and validate Retrieval-Augmented Generation (RAG-based systems), including ground truth evaluationNice to Have
Experience with Azure OpenAIFamiliarity with OpenSearch (vector databases)Exposure to monitoring tools like DatadogWhat Makes You a Great Fit
You can identify gaps in AI response validation and improve quality rigorYou're comfortable working with ambiguous or partially correct AI outputsYou bring a hands-on approach to problem-solving-not just strategyYou can help ensure release readiness under tight timelinesWhy Join BLS360?
Work on cutting-edge AI + cybersecurity solutionsBe part of a rapidly growing global CyberTech companyCollaborate with global teams on impactful projectsOpportunity to build impactful products, solutions, services and beyond.Play a key role in shaping quality standards for AI applications Read LessRemote (India)
12 PM - 8 PM IST
Contract: 2 Years
Onboarding: Immediate
About BLS360
BLS360 is a fast-growing cybersecurity, identity & access management (IAM), and digital transformation company, helping enterprises secure and modernize their technology landscape. Founded in 2019, BLS360 delivers scalable, secure, and customized solutions across industries including finance, healthcare, and government.
With strong partnerships across leading cloud and identity platforms, BLS360 focuses on identity-centric security, compliance, and next-gen digital innovation, enabling organizations to navigate complex, multi-cloud environments with confidence.
Role Overview
We're looking for a Senior AI QA / QE Engineer to lead quality engineering efforts for cutting-edge AI-powered applications. This role is ideal for someone who thrives at the intersection of QA, automation, and AI systems, and can ensure reliability in complex, non-deterministic environments.
What You'll Do
Lead QA strategy and execution for AI-driven applications and systemsBuild and maintain automated test frameworks (Python, Robot Framework) across APIs, UI, backend, and data pipelinesIntegrate automated tests into CI/CD pipelinesPerform functional, performance, and exploratory testingValidate AI/LLM outputs using structured and non-deterministic testing approachesConduct prompt testing and evaluate LLM behavior (PromptFoo experience preferred)Test and validate RAG-based systems, including ground truth evaluationCollaborate with engineering and product teams to define quality benchmarksDebug complex issues, including AI/LLM-specific challengesMust-Have Skills
Strong experience in QA automation and test strategyHands-on experience testing AI/LLM-powered applications and agentsExpertise in non-deterministic output validation and ground truth comparisonExperience with RAG testing and validationProficiency in Python-based automation frameworksSolid understanding of defect analysis and system debuggingExperience working in Agile environments with tools like JiraTest and validate Retrieval-Augmented Generation (RAG-based systems), including ground truth evaluationNice to Have
Experience with Azure OpenAIFamiliarity with OpenSearch (vector databases)Exposure to monitoring tools like DatadogWhat Makes You a Great Fit
You can identify gaps in AI response validation and improve quality rigorYou're comfortable working with ambiguous or partially correct AI outputsYou bring a hands-on approach to problem-solving-not just strategyYou can help ensure release readiness under tight timelinesWhy Join BLS360?
Work on cutting-edge AI + cybersecurity solutionsBe part of a rapidly growing global CyberTech companyCollaborate with global teams on impactful projectsOpportunity to build impactful products, solutions, services and beyond.Play a key role in shaping quality standards for AI applications Read LessRemote (India)
12 PM - 8 PM IST
Contract: 2 Years
Onboarding: Immediate
About BLS360
BLS360 is a fast-growing cybersecurity, identity & access management (IAM), and digital transformation company, helping enterprises secure and modernize their technology landscape. Founded in 2019, BLS360 delivers scalable, secure, and customized solutions across industries including finance, healthcare, and government.
With strong partnerships across leading cloud and identity platforms, BLS360 focuses on identity-centric security, compliance, and next-gen digital innovation, enabling organizations to navigate complex, multi-cloud environments with confidence.
Role Overview
We're looking for a Senior AI QA / QE Engineer to lead quality engineering efforts for cutting-edge AI-powered applications. This role is ideal for someone who thrives at the intersection of QA, automation, and AI systems, and can ensure reliability in complex, non-deterministic environments.
What You'll Do
Lead QA strategy and execution for AI-driven applications and systemsBuild and maintain automated test frameworks (Python, Robot Framework) across APIs, UI, backend, and data pipelinesIntegrate automated tests into CI/CD pipelinesPerform functional, performance, and exploratory testingValidate AI/LLM outputs using structured and non-deterministic testing approachesConduct prompt testing and evaluate LLM behavior (PromptFoo experience preferred)Test and validate RAG-based systems, including ground truth evaluationCollaborate with engineering and product teams to define quality benchmarksDebug complex issues, including AI/LLM-specific challengesMust-Have Skills
Strong experience in QA automation and test strategyHands-on experience testing AI/LLM-powered applications and agentsExpertise in non-deterministic output validation and ground truth comparisonExperience with RAG testing and validationProficiency in Python-based automation frameworksSolid understanding of defect analysis and system debuggingExperience working in Agile environments with tools like JiraTest and validate Retrieval-Augmented Generation (RAG-based systems), including ground truth evaluationNice to Have
Experience with Azure OpenAIFamiliarity with OpenSearch (vector databases)Exposure to monitoring tools like DatadogWhat Makes You a Great Fit
You can identify gaps in AI response validation and improve quality rigorYou're comfortable working with ambiguous or partially correct AI outputsYou bring a hands-on approach to problem-solving-not just strategyYou can help ensure release readiness under tight timelinesWhy Join BLS360?
Work on cutting-edge AI + cybersecurity solutionsBe part of a rapidly growing global CyberTech companyCollaborate with global teams on impactful projectsOpportunity to build impactful products, solutions, services and beyond.Play a key role in shaping quality standards for AI applications Read LessRemote (India)
12 PM - 8 PM IST
Contract: 2 Years
Onboarding: Immediate
About BLS360
BLS360 is a fast-growing cybersecurity, identity & access management (IAM), and digital transformation company, helping enterprises secure and modernize their technology landscape. Founded in 2019, BLS360 delivers scalable, secure, and customized solutions across industries including finance, healthcare, and government.
With strong partnerships across leading cloud and identity platforms, BLS360 focuses on identity-centric security, compliance, and next-gen digital innovation, enabling organizations to navigate complex, multi-cloud environments with confidence.
Role Overview
We're looking for a Senior AI QA / QE Engineer to lead quality engineering efforts for cutting-edge AI-powered applications. This role is ideal for someone who thrives at the intersection of QA, automation, and AI systems, and can ensure reliability in complex, non-deterministic environments.
What You'll Do
Lead QA strategy and execution for AI-driven applications and systemsBuild and maintain automated test frameworks (Python, Robot Framework) across APIs, UI, backend, and data pipelinesIntegrate automated tests into CI/CD pipelinesPerform functional, performance, and exploratory testingValidate AI/LLM outputs using structured and non-deterministic testing approachesConduct prompt testing and evaluate LLM behavior (PromptFoo experience preferred)Test and validate RAG-based systems, including ground truth evaluationCollaborate with engineering and product teams to define quality benchmarksDebug complex issues, including AI/LLM-specific challengesMust-Have Skills
Strong experience in QA automation and test strategyHands-on experience testing AI/LLM-powered applications and agentsExpertise in non-deterministic output validation and ground truth comparisonExperience with RAG testing and validationProficiency in Python-based automation frameworksSolid understanding of defect analysis and system debuggingExperience working in Agile environments with tools like JiraTest and validate Retrieval-Augmented Generation (RAG-based systems), including ground truth evaluationNice to Have
Experience with Azure OpenAIFamiliarity with OpenSearch (vector databases)Exposure to monitoring tools like DatadogWhat Makes You a Great Fit
You can identify gaps in AI response validation and improve quality rigorYou're comfortable working with ambiguous or partially correct AI outputsYou bring a hands-on approach to problem-solving-not just strategyYou can help ensure release readiness under tight timelinesWhy Join BLS360?
Work on cutting-edge AI + cybersecurity solutionsBe part of a rapidly growing global CyberTech companyCollaborate with global teams on impactful projectsOpportunity to build impactful products, solutions, services and beyond.Play a key role in shaping quality standards for AI applications Read LessRemote (India)
12 PM - 8 PM IST
Contract: 2 Years
Onboarding: Immediate
About BLS360
BLS360 is a fast-growing cybersecurity, identity & access management (IAM), and digital transformation company, helping enterprises secure and modernize their technology landscape. Founded in 2019, BLS360 delivers scalable, secure, and customized solutions across industries including finance, healthcare, and government.
With strong partnerships across leading cloud and identity platforms, BLS360 focuses on identity-centric security, compliance, and next-gen digital innovation, enabling organizations to navigate complex, multi-cloud environments with confidence.
Role Overview
We're looking for a Senior AI QA / QE Engineer to lead quality engineering efforts for cutting-edge AI-powered applications. This role is ideal for someone who thrives at the intersection of QA, automation, and AI systems, and can ensure reliability in complex, non-deterministic environments.
What You'll Do
Lead QA strategy and execution for AI-driven applications and systemsBuild and maintain automated test frameworks (Python, Robot Framework) across APIs, UI, backend, and data pipelinesIntegrate automated tests into CI/CD pipelinesPerform functional, performance, and exploratory testingValidate AI/LLM outputs using structured and non-deterministic testing approachesConduct prompt testing and evaluate LLM behavior (PromptFoo experience preferred)Test and validate RAG-based systems, including ground truth evaluationCollaborate with engineering and product teams to define quality benchmarksDebug complex issues, including AI/LLM-specific challengesMust-Have Skills
Strong experience in QA automation and test strategyHands-on experience testing AI/LLM-powered applications and agentsExpertise in non-deterministic output validation and ground truth comparisonExperience with RAG testing and validationProficiency in Python-based automation frameworksSolid understanding of defect analysis and system debuggingExperience working in Agile environments with tools like JiraTest and validate Retrieval-Augmented Generation (RAG-based systems), including ground truth evaluationNice to Have
Experience with Azure OpenAIFamiliarity with OpenSearch (vector databases)Exposure to monitoring tools like DatadogWhat Makes You a Great Fit
You can identify gaps in AI response validation and improve quality rigorYou're comfortable working with ambiguous or partially correct AI outputsYou bring a hands-on approach to problem-solving-not just strategyYou can help ensure release readiness under tight timelinesWhy Join BLS360?
Work on cutting-edge AI + cybersecurity solutionsBe part of a rapidly growing global CyberTech companyCollaborate with global teams on impactful projectsOpportunity to build impactful products, solutions, services and beyond.Play a key role in shaping quality standards for AI applications Read LessRemote (India)
12 PM - 8 PM IST
Contract: 2 Years
Onboarding: Immediate
About BLS360
BLS360 is a fast-growing cybersecurity, identity & access management (IAM), and digital transformation company, helping enterprises secure and modernize their technology landscape. Founded in 2019, BLS360 delivers scalable, secure, and customized solutions across industries including finance, healthcare, and government.
With strong partnerships across leading cloud and identity platforms, BLS360 focuses on identity-centric security, compliance, and next-gen digital innovation, enabling organizations to navigate complex, multi-cloud environments with confidence.
Role Overview
We're looking for a Senior AI QA / QE Engineer to lead quality engineering efforts for cutting-edge AI-powered applications. This role is ideal for someone who thrives at the intersection of QA, automation, and AI systems, and can ensure reliability in complex, non-deterministic environments.
What You'll Do
Lead QA strategy and execution for AI-driven applications and systemsBuild and maintain automated test frameworks (Python, Robot Framework) across APIs, UI, backend, and data pipelinesIntegrate automated tests into CI/CD pipelinesPerform functional, performance, and exploratory testingValidate AI/LLM outputs using structured and non-deterministic testing approachesConduct prompt testing and evaluate LLM behavior (PromptFoo experience preferred)Test and validate RAG-based systems, including ground truth evaluationCollaborate with engineering and product teams to define quality benchmarksDebug complex issues, including AI/LLM-specific challengesMust-Have Skills
Strong experience in QA automation and test strategyHands-on experience testing AI/LLM-powered applications and agentsExpertise in non-deterministic output validation and ground truth comparisonExperience with RAG testing and validationProficiency in Python-based automation frameworksSolid understanding of defect analysis and system debuggingExperience working in Agile environments with tools like JiraTest and validate Retrieval-Augmented Generation (RAG-based systems), including ground truth evaluationNice to Have
Experience with Azure OpenAIFamiliarity with OpenSearch (vector databases)Exposure to monitoring tools like DatadogWhat Makes You a Great Fit
You can identify gaps in AI response validation and improve quality rigorYou're comfortable working with ambiguous or partially correct AI outputsYou bring a hands-on approach to problem-solving-not just strategyYou can help ensure release readiness under tight timelinesWhy Join BLS360?
Work on cutting-edge AI + cybersecurity solutionsBe part of a rapidly growing global CyberTech companyCollaborate with global teams on impactful projectsOpportunity to build impactful products, solutions, services and beyond.Play a key role in shaping quality standards for AI applications Read LessRemote (India)
12 PM - 8 PM IST
Contract: 2 Years
Onboarding: Immediate
About BLS360
BLS360 is a fast-growing cybersecurity, identity & access management (IAM), and digital transformation company, helping enterprises secure and modernize their technology landscape. Founded in 2019, BLS360 delivers scalable, secure, and customized solutions across industries including finance, healthcare, and government.
With strong partnerships across leading cloud and identity platforms, BLS360 focuses on identity-centric security, compliance, and next-gen digital innovation, enabling organizations to navigate complex, multi-cloud environments with confidence.
Role Overview
We're looking for a Senior AI QA / QE Engineer to lead quality engineering efforts for cutting-edge AI-powered applications. This role is ideal for someone who thrives at the intersection of QA, automation, and AI systems, and can ensure reliability in complex, non-deterministic environments.
What You'll Do
Lead QA strategy and execution for AI-driven applications and systemsBuild and maintain automated test frameworks (Python, Robot Framework) across APIs, UI, backend, and data pipelinesIntegrate automated tests into CI/CD pipelinesPerform functional, performance, and exploratory testingValidate AI/LLM outputs using structured and non-deterministic testing approachesConduct prompt testing and evaluate LLM behavior (PromptFoo experience preferred)Test and validate RAG-based systems, including ground truth evaluationCollaborate with engineering and product teams to define quality benchmarksDebug complex issues, including AI/LLM-specific challengesMust-Have Skills
Strong experience in QA automation and test strategyHands-on experience testing AI/LLM-powered applications and agentsExpertise in non-deterministic output validation and ground truth comparisonExperience with RAG testing and validationProficiency in Python-based automation frameworksSolid understanding of defect analysis and system debuggingExperience working in Agile environments with tools like JiraTest and validate Retrieval-Augmented Generation (RAG-based systems), including ground truth evaluationNice to Have
Experience with Azure OpenAIFamiliarity with OpenSearch (vector databases)Exposure to monitoring tools like DatadogWhat Makes You a Great Fit
You can identify gaps in AI response validation and improve quality rigorYou're comfortable working with ambiguous or partially correct AI outputsYou bring a hands-on approach to problem-solving-not just strategyYou can help ensure release readiness under tight timelinesWhy Join BLS360?
Work on cutting-edge AI + cybersecurity solutionsBe part of a rapidly growing global CyberTech companyCollaborate with global teams on impactful projectsOpportunity to build impactful products, solutions, services and beyond.Play a key role in shaping quality standards for AI applications Read LessRemote (India)
12 PM - 8 PM IST
Contract: 2 Years
Onboarding: Immediate
About BLS360
BLS360 is a fast-growing cybersecurity, identity & access management (IAM), and digital transformation company, helping enterprises secure and modernize their technology landscape. Founded in 2019, BLS360 delivers scalable, secure, and customized solutions across industries including finance, healthcare, and government.
With strong partnerships across leading cloud and identity platforms, BLS360 focuses on identity-centric security, compliance, and next-gen digital innovation, enabling organizations to navigate complex, multi-cloud environments with confidence.
Role Overview
We're looking for a Senior AI QA / QE Engineer to lead quality engineering efforts for cutting-edge AI-powered applications. This role is ideal for someone who thrives at the intersection of QA, automation, and AI systems, and can ensure reliability in complex, non-deterministic environments.
What You'll Do
Lead QA strategy and execution for AI-driven applications and systemsBuild and maintain automated test frameworks (Python, Robot Framework) across APIs, UI, backend, and data pipelinesIntegrate automated tests into CI/CD pipelinesPerform functional, performance, and exploratory testingValidate AI/LLM outputs using structured and non-deterministic testing approachesConduct prompt testing and evaluate LLM behavior (PromptFoo experience preferred)Test and validate RAG-based systems, including ground truth evaluationCollaborate with engineering and product teams to define quality benchmarksDebug complex issues, including AI/LLM-specific challengesMust-Have Skills
Strong experience in QA automation and test strategyHands-on experience testing AI/LLM-powered applications and agentsExpertise in non-deterministic output validation and ground truth comparisonExperience with RAG testing and validationProficiency in Python-based automation frameworksSolid understanding of defect analysis and system debuggingExperience working in Agile environments with tools like JiraTest and validate Retrieval-Augmented Generation (RAG-based systems), including ground truth evaluationNice to Have
Experience with Azure OpenAIFamiliarity with OpenSearch (vector databases)Exposure to monitoring tools like DatadogWhat Makes You a Great Fit
You can identify gaps in AI response validation and improve quality rigorYou're comfortable working with ambiguous or partially correct AI outputsYou bring a hands-on approach to problem-solving-not just strategyYou can help ensure release readiness under tight timelinesWhy Join BLS360?
Work on cutting-edge AI + cybersecurity solutionsBe part of a rapidly growing global CyberTech companyCollaborate with global teams on impactful projectsOpportunity to build impactful products, solutions, services and beyond.Play a key role in shaping quality standards for AI applications Read LessRemote (India)
12 PM - 8 PM IST
Contract: 2 Years
Onboarding: Immediate
About BLS360
BLS360 is a fast-growing cybersecurity, identity & access management (IAM), and digital transformation company, helping enterprises secure and modernize their technology landscape. Founded in 2019, BLS360 delivers scalable, secure, and customized solutions across industries including finance, healthcare, and government.
With strong partnerships across leading cloud and identity platforms, BLS360 focuses on identity-centric security, compliance, and next-gen digital innovation, enabling organizations to navigate complex, multi-cloud environments with confidence.
Role Overview
We're looking for a Senior AI QA / QE Engineer to lead quality engineering efforts for cutting-edge AI-powered applications. This role is ideal for someone who thrives at the intersection of QA, automation, and AI systems, and can ensure reliability in complex, non-deterministic environments.
What You'll Do
Lead QA strategy and execution for AI-driven applications and systemsBuild and maintain automated test frameworks (Python, Robot Framework) across APIs, UI, backend, and data pipelinesIntegrate automated tests into CI/CD pipelinesPerform functional, performance, and exploratory testingValidate AI/LLM outputs using structured and non-deterministic testing approachesConduct prompt testing and evaluate LLM behavior (PromptFoo experience preferred)Test and validate RAG-based systems, including ground truth evaluationCollaborate with engineering and product teams to define quality benchmarksDebug complex issues, including AI/LLM-specific challengesMust-Have Skills
Strong experience in QA automation and test strategyHands-on experience testing AI/LLM-powered applications and agentsExpertise in non-deterministic output validation and ground truth comparisonExperience with RAG testing and validationProficiency in Python-based automation frameworksSolid understanding of defect analysis and system debuggingExperience working in Agile environments with tools like JiraTest and validate Retrieval-Augmented Generation (RAG-based systems), including ground truth evaluationNice to Have
Experience with Azure OpenAIFamiliarity with OpenSearch (vector databases)Exposure to monitoring tools like DatadogWhat Makes You a Great Fit
You can identify gaps in AI response validation and improve quality rigorYou're comfortable working with ambiguous or partially correct AI outputsYou bring a hands-on approach to problem-solving-not just strategyYou can help ensure release readiness under tight timelinesWhy Join BLS360?
Work on cutting-edge AI + cybersecurity solutionsBe part of a rapidly growing global CyberTech companyCollaborate with global teams on impactful projectsOpportunity to build impactful products, solutions, services and beyond.Play a key role in shaping quality standards for AI applications Read LessRemote (India)
12 PM - 8 PM IST
Contract: 2 Years
Onboarding: Immediate
About BLS360
BLS360 is a fast-growing cybersecurity, identity & access management (IAM), and digital transformation company, helping enterprises secure and modernize their technology landscape. Founded in 2019, BLS360 delivers scalable, secure, and customized solutions across industries including finance, healthcare, and government.
With strong partnerships across leading cloud and identity platforms, BLS360 focuses on identity-centric security, compliance, and next-gen digital innovation, enabling organizations to navigate complex, multi-cloud environments with confidence.
Role Overview
We're looking for a Senior AI QA / QE Engineer to lead quality engineering efforts for cutting-edge AI-powered applications. This role is ideal for someone who thrives at the intersection of QA, automation, and AI systems, and can ensure reliability in complex, non-deterministic environments.
What You'll Do
Lead QA strategy and execution for AI-driven applications and systemsBuild and maintain automated test frameworks (Python, Robot Framework) across APIs, UI, backend, and data pipelinesIntegrate automated tests into CI/CD pipelinesPerform functional, performance, and exploratory testingValidate AI/LLM outputs using structured and non-deterministic testing approachesConduct prompt testing and evaluate LLM behavior (PromptFoo experience preferred)Test and validate RAG-based systems, including ground truth evaluationCollaborate with engineering and product teams to define quality benchmarksDebug complex issues, including AI/LLM-specific challengesMust-Have Skills
Strong experience in QA automation and test strategyHands-on experience testing AI/LLM-powered applications and agentsExpertise in non-deterministic output validation and ground truth comparisonExperience with RAG testing and validationProficiency in Python-based automation frameworksSolid understanding of defect analysis and system debuggingExperience working in Agile environments with tools like JiraTest and validate Retrieval-Augmented Generation (RAG-based systems), including ground truth evaluationNice to Have
Experience with Azure OpenAIFamiliarity with OpenSearch (vector databases)Exposure to monitoring tools like DatadogWhat Makes You a Great Fit
You can identify gaps in AI response validation and improve quality rigorYou're comfortable working with ambiguous or partially correct AI outputsYou bring a hands-on approach to problem-solving-not just strategyYou can help ensure release readiness under tight timelinesWhy Join BLS360?
Work on cutting-edge AI + cybersecurity solutionsBe part of a rapidly growing global CyberTech companyCollaborate with global teams on impactful projectsOpportunity to build impactful products, solutions, services and beyond.Play a key role in shaping quality standards for AI applications Read Less