scripts for custom ETL processes and automation in Azure data factory, Azure databricks, Python, Pyspark etc. · Good... ETL processes and automation in Azure data factory, Azure databricks, Delta lake, Databricks workflows orchestration...
Applies knowledge of tools within the Software Development Life Cycle toolchain to improve the value realized by automation.... Experience with Databricks: Proficient in building and managing data pipelines, notebooks, and workflows within the Databricks...
). Databricks platform proficiency (Unity Catalog, SQL Warehouses, job/cluster policies, MLflow basics). Automation and CI/CD... Plan and deliver SAS-to-PySpark migrations on Databricks (cutover, validation, rollback). Build and maintain automated...
AHEAD builds platforms for digital business. By weaving together advances in cloud infrastructure, automation... of ideas and perspectives at AHEAD. What you'll do Architect, build, and optimize Azure Databricks solutions (batch...
Do: Develop groundbreaking agentic workflows tailored to task automation within inhouse, and 3rd party licensed software service... within production environments effectively. FactSet’s AI & Automation team works to improve productivity of all employees using...
Do: Develop groundbreaking agentic workflows tailored to task automation within inhouse, and 3rd party licensed software service... with python notebooks in Databricks (or similar tech stack) is essential Strong hands-on experience with LLM SaaS providers...
) and azure databricks for data integration and processing. Strong skills in writing complex sql queries for data manipulation... for automation and scripting tasks. Solid understanding of data warehousing concepts, etl processes, and data modeling. Ability...
- Databricks Developer with experience in Unity Catalog + Python , Spark , Kafka for ETL! In this role, the Databricks Developer.... Responsibilities Develop and maintain scalable ETL pipelines using Databricks with a focus on Unity Catalog for data asset management...
automation Certification in Python/ Databricks /AWS is a plus. Responsibilities · Understand back-end and front-end...Automation Engineer Advisor Position Overview The Automation Engineer advisor will be responsible for the strategy...
. By harnessing automation, CI/CD pipelines, and agentic AI, we’re creating solutions that drive efficiency and innovation... Services (Azure Data Factory, Databricks, Azure Data Lake Storage, Azure Blob, SQL Server. Function Apps, Azure Key Vaults...
experience in Python or similar for building reusable ETL components, libraries, and automation. Experience with streaming... and batch ingestion patterns (e.g., Kafka, Spark, Databricks) feeding Snowflake. Familiarity with BI and analytics tools (e.g...
. Implement and optimize CI/CD pipelines using GitLab and AWS. Leverage cloud services (AWS Lambda, S3, Databricks... databases, ETL pipelines, big data technologies (e.g. Databricks), semantic data standards (OWL, W3C, FAIR principles), ontology...
Cloud, GitHub‑based CI/CD, and AI‑driven automation for data modelling and data engineering processes..., and introducing intelligent automation (e.g., code generation, metadata‑driven modelling, quality checks) to scale our data platform...
in Proof of Concept (POC) efforts on new tools, technologies (including Gen AI / LLM-based solutions), and automation use cases... validation, root-cause analysis, and reporting. Exposure to cloud and data platforms (e.g., AWS, Redshift, Databricks or similar...
with cybersecurity teams to identify data-driven automation opportunities, strengthening the organization’s security posture. Roles...-series data for forecasting and trend analysis Experience with AWS, Azure, or Google Cloud Experience with Databricks...
expertise in Databricks, Azure Data Factory (ADF), Python, PySpark and Unity Catalog to efficiently process and analyze large... ingestion and transformation pipelines using Azure ADF and Databricks. Implement data integration and transformation solutions...
quality, efficiency, and automation. Support senior team members in Proof of Concept (POC) activities on new tools..., Informatica, AWS, Redshift, Databricks, or similar) – coursework, projects, or work experience. Ability to learn quickly...
, preferably in corporate or academic settings. Certification in areas like GenAI, Databricks etc. Preferred Qualifications... to stakeholders effectively. Why join Genpact? Be a transformation leader – Work at the cutting edge of AI, automation...
Engineering teams to build robust, automated ETL/ELT pipelines using tools such as Apache Spark, Databricks, Kafka, or Oracle... with infrastructure-as-code (e.g., Terraform), automation (Python/Scala), and containerization (Kubernetes, Docker). Familiarity...
– Apply OpenAI and other LLM frameworks to drive automation, contextual intelligence, and enhanced decision-making. Workforce... with experience in related field. Additional certifications in AI/ML, Databricks, Dataiku Preferred Qualifications / Skills...