. in Computer Science, Computer Engineering, or equivalent. Proficiency in Python; working proficiency in Scala. Strong experience... such as Airflow; ability to build maintainable DAGs and operationalize workflows. Strong expertise with at least one major cloud...
Python Airflow WorkMode : work from office Work Location : Chennai / Hyderabad / Bangalore Work Timing : 2 PM to 11... PM Primary : Python Airflow Years of Experience: 7-10 Years Job Summary: We are seeking an experienced Data Engineer...
: Build and optimize ETL/ELT pipelines using Python, Airflow, and DBT to ingest, transform, and load data into Snowflake..., and governance standards are met throughout the migration process. SKILLS Must have Python, Airflow / DBT, Docker...
(preferably in Databricks), Scala, Python and Airflow. Databricks & Azure Big Data Architecture Certification... using UNIX scripting languages such as ksh, Python, Spark, Scala, etc. Minimum of 10+ years of relevant experience...
opportunity We are seeking a Senior Data Engineer with strong Python expertise to join our team. The core purpose is to design... and attributes for success Technical Foundation: Need strong programming skills, particularly in Python, with hands-on experience...
, Dataproc, Data Fusion, TERRAFORM, Tekton,Cloud SQL, AIRFLOW, POSTGRES, Airflow PySpark, Python, API Skills Preferred: Big...
like Vertex AI. Develop and optimize ETL/ELT pipelines using tools like Python, SQL, and streaming technologies (e.g., Kafka..., Apache Airflow). Architect Historical and Incremental Loads and Refine Architecture on an ongoing basis Manage and optimize...
Kafka, Apache Airflow, SQLMESH, Snowflake Languages & Frameworks: Python, SQL, Java, Docker Monitoring & Observability... What You Bring Technical Foundation Working knowledge of Python for scripting and basic automation Basic SQL skills...
Snowflake Developer \n Primary Skills DataStream, ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data... • Workflow Orchestration: Airflow Qualifications: • Bachelor's or Master's degree in Computer Science, Data Engineering...
QueryDatabricksJavaKubernetesData EngineeringPythonApache Airflow Contact our TA to know more about the job Rashi Modi Talent Advocate...: Develop custom APIs and microservices using Java/Python/C# to facilitate data movement between niche systems and the data...
Deep Technical Expertise Expert-level proficiency in SQL, Python, and at least one additional programming language... orchestration platforms like Airflow, Prefect, or Dagster Demonstrated success modernizing legacy data systems while ensuring...
and microservices using Java/Python/C# to facilitate data movement between niche systems and the data lakehouse. Infrastructure... like Apache Airflow (Cloud Composer). Experience implementing Data Governance (metadata management, data cataloging). Data...
and in the cloud (Azure and GCP), includes MapR, Airflow, Spark, Kafka, jupyter, Kubeflow, Jenkins, GitHub, Tableau, Power BI... into AI applications. Very good in Python Programming. Power BI, Tableau Develop the application and deploy the model in production...
(Beam), Pub/Sub, Composer (Airflow), Cloud Functions, IAM, VPC-SC; Terraform/IaC. Languages: Python, PySpark, Scala... (data lakehouse/warehouse, streaming, governance) with hands-on engineering (Python, PySpark, Scala) and TPM leadership...
, AlloyDB. Proficient in SQL, Python, Airflow, DBT. Experience with data modelling, schema design, and partitioning strategies... tools such as Dataflow, Dataproc(Apache Beam), Cloud Composer (Airflow) and DBT. Build and optimize data warehouses...
in Python, SQL, Scala Direct experience of building data pipelines using Apache Spark (preferably in Databricks), Airflow..., Airflow, SQL, Docker, Kubernetes, and other Data engineering tools. These technologies are deployed using DevOps pipelines...
Hands-on experience with Apache Airflow for orchestration Strong SQL skills (BigQuery preferred) Proficiency in Python... platforms on Google Cloud Platform, leveraging Databricks, dbt, and Apache Airflow. You will work closely with product teams...
scalable data platforms on Google Cloud Platform, leveraging Databricks, dbt, and Apache Airflow. You will work closely... and dependencies using Apache Airflow Work with BigQuery, Cloud Storage, Pub/Sub, and other GCP services Implement data quality...
Must have 6-8 yrs of experience Essential: Strong understanding or even hands-on ML experience, Python (needs to be very... strong), SQL, Terraform, GCP (esp Vertex, BigQuery, Model Registry), Docker, FastAPI (or similar), Ray Airflow / GCP Composer...
, experimental design, and analysis of A/B tests. Expert SQL ability and proficiency with 1+ programming languages (e.g., Python...). Experience building automated big data pipelines using tools like Airflow and/or dbt. Degree in data science, computer science...