the whole data lifecycle. Oversee Data infrastructure to ensure robust deployment and monitoring of the pipelines... (Spark, Kafka, Airflow). Bachelor's degree in Computer Science, Engineering, or related field; Master's degree preferred...
to meet financial-industry standards. Providing self-service tooling and infrastructure that enables data scientists... and workflow tools (Airflow, Dagster, equivalent). Proficiency in containerization and orchestration (Docker, Kubernetes...
, transformation, and orchestration pipelines. Collaborate closely with frontend, ML, and infrastructure teams to deliver stable... You’ll Work With: Languages: Python (primary), SQL Frameworks: FastAPI, Flask (secondary), asyncio Infrastructure...
integration and orchestration frameworks in AWS (Lambda, Airflow, Step Functions). Requirements Design and implement event... solutions.. Automate build, testing, and deployment processes using YAML pipelines and Infrastructure-as-Code templates...
infrastructure that supports analytics, reporting, and machine learning workflows. You will collaborate closely with cross-functional... Data Factory, Airflow, or Pentaho. Solid understanding of data modeling, architecture, and data warehousing principles...
. Participate in monitoring, troubleshooting, and improving data infrastructure for performance and reliability. Stay... to CI/CD, Docker, or orchestration tools like Airflow. Benefits Why Join Us? Opportunity to work on high-impact data...
, Kubernetes), CI/CD pipelines (Jenkins, GitLab CI, GitHub Actions), and Infrastructure as Code (Terraform, CloudFormation...) o Data Integration Platforms: Experience with platforms like Airbyte, Apache Kafka, Apache Airflow, or similar ETL/ELT tools...
Client Kinesis, AWS Managed Airflow and AWS Managed Kafka (preferred) Solid experience building solutions on AWS data lake... corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions...
: Optimizing Airflow DAGs and underlying data processes for performance, scalability, and resource utilization. Workflow.... Data Pipeline Development: Designing, implementing, and maintaining complex data pipelines (DAGs) in Apache Airflow...
like Jira and Confluence Familiar with infrastructure provisioning tools like Terraform and workflow orchestration tools... like Airflow...
tuning of code and align it with the appropriate infrastructure to optimize efficiency. Validate results with user... deliverable documents including design documents architecture documents infrastructure costing business requirements source...
tuning of code and align it with the appropriate infrastructure to optimize efficiency. Validate results with user... deliverable documents including design documents architecture documents infrastructure costing business requirements source...
in advanced computer chips, quantum computing, artificial intelligence, and data infrastructure. Essential Job Functions... such as dbt, Airflow, or Snowflake-native features Support analytics and data science teams with optimized, well-structured...
Engineer (DBRE) and help shape the future of data infrastructure across our global enterprise. As part of the central Database... using tools like Airflow, dbt, or similar frameworks. Proficiency in Python for scripting and automation. Advanced SQL...
Python or other programming languages utilized for data manipulation. Experience with ETL tools such as Apache Airflow... teams to enhance data infrastructure and analytics capabilities. Key Responsibilities: • Lead and deliver projects...
on Docusign infrastructure with a strong emphasis on security and governance * Build autonomous and workflow-based agents... including VPC, IAM, MWAA (Managed Workflows for Apache Airflow), and ECS Familiarity with software development best practices...
tuning of code and align it with the appropriate infrastructure to optimize efficiency. Validate results with user... deliverable documents including design documents architecture documents infrastructure costing business requirements source...
that enhance IT infrastructure performance, automate routine tasks, and ensure system reliability. The Senior AI Ops Engineer... latest advancements in AI/ML technologies to maintain a cutting-edge IT infrastructure (i.e., newly developed Large Language...
of our cloud infrastructure and CI/CD pipelines. The ideal candidate will have deep expertise inMicrosoft Azureand working... knowledge ofAWS, with a strong background in infrastructure as code, automation, and cloud-first architecture. It...
Experience (Hadoop / Spark / Airflow) Monitor and maintain platform performance across production and staging environments... with development, QA, and infrastructure teams to ensure smooth deployment and operation of applications. Document incidents...