Information Technology_USA - USA_Developer

Real Soft•Jacksonville, FL
•Onsite

About The Position

We are seeking an experienced AI Performance Test Architect to join our team. This role is crucial for ensuring the performance, scalability, and reliability of our systems, with a specific focus on leveraging AI and Machine Learning technologies. The ideal candidate will have deep expertise in performance testing tools, APM & Observability, bottleneck analysis, CI/CD integration, and cloud platforms. A strong understanding of AI/ML and Generative AI skills is required, including experience with AI-powered observability, predictive performance analytics, anomaly detection, and using GenAI tools for engineering productivity. You will be responsible for designing and implementing performance testing strategies that incorporate AI-driven approaches to enhance efficiency and effectiveness.

Requirements

  • Deep expertise in Load Testing Tools: JMeter, LoadRunner, Gatling, k6, NeoLoad, or BlazeMeter.
  • Strong hands-on experience with APM & Observability tools: Datadog, Azure Application Insights, and exposure to Dynatrace, New Relic, AppDynamics, Splunk, Grafana, or Prometheus.
  • Expert-level skills in performance bottleneck identification (CPU, memory, threads, GC, database queries, network latency, microservices).
  • Experience integrating performance testing into CI/CD pipelines using Jenkins, Azure DevOps, GitHub Actions, or GitLab CI.
  • Working knowledge of Cloud Platforms: AWS, Azure, or GCP (auto-scaling, load balancing, cloud-native performance considerations).
  • Proficiency in Scripting & Programming: Java, Python, Groovy, or JavaScript.
  • Strong understanding of Protocols & Architectures: HTTP/HTTPS, REST/SOAP APIs, WebSockets, microservices, message queues (Kafka, RabbitMQ), and database performance (SQL/NoSQL).
  • Hands-on experience with AIOps platforms and AI-driven APM features (e.g., Datadog Watchdog/Bits AI, Dynatrace Davis AI, New Relic AI, Azure AI Anomaly Detector).
  • Experience using ML models for capacity forecasting, performance trend analysis, and proactive bottleneck prediction.
  • Ability to design or leverage AI/ML models for automated anomaly detection, intelligent alerting, noise reduction, and AI-assisted RCA.
  • Practical experience using GenAI tools (ChatGPT, Copilot, Claude, Gemini) for automated script generation, test data creation, log/trace summarization, and intelligent reporting.
  • Working knowledge of Python data libraries (Pandas, NumPy, Scikit-learn), time-series analysis, and basic ML concepts applied to performance datasets.
  • Familiarity with AI-driven approaches for self-healing test scripts, smart workload modeling, and risk-based performance test selection.
  • Ability to craft effective prompts for LLMs in performance engineering workflows.
  • 4-6 years of experience in performance testing and AI/ML applications.

Nice To Haves

  • Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or related field.
  • Industry certifications in performance engineering, cloud platforms (AWS/Azure), APM tools (Datadog, Dynatrace), or AI/ML certifications (Azure AI Engineer, AWS ML Specialty, Google ML Engineer).
  • Experience in regulated industries (Financial Services, Healthcare, Insurance).
  • Knowledge of chaos engineering, resilience testing, and AI-driven SRE practices.
  • Experience building or integrating custom ML models or LLM-based agents to support performance engineering workflows.

Responsibilities

  • Design and implement AI-driven performance testing strategies.
  • Utilize AI-powered observability tools for performance monitoring and analysis.
  • Apply ML models for capacity forecasting and performance trend analysis.
  • Leverage AI/ML for automated anomaly detection and intelligent alerting.
  • Use GenAI tools for automated script generation, test data creation, and intelligent reporting.
  • Integrate performance testing into CI/CD pipelines.
  • Identify and analyze performance bottlenecks across various system components.
  • Script and automate performance tests using proficiency in Java, Python, Groovy, or JavaScript.
  • Collaborate with development and operations teams to ensure system performance and scalability.
  • Stay current with emerging trends in AI, ML, and performance engineering.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service