Python Airflow WorkMode : work from office Work Location : Chennai / Hyderabad / Bangalore Work Timing : 2 PM to 11... PM Primary : Python Airflow Years of Experience: 7-10 Years Job Summary: We are seeking an experienced Data Engineer...
with Scala or Python) to ingest, transform, and load large datasets from diverse sources. Write, optimize, and troubleshoot...: Strong proficiency with Apache Spark (DataFrames API, Spark SQL) using Scala or Python. Databases: Expert-level SQL skills. Extensive...
with Scala or Python) to ingest, transform, and load large datasets from diverse sources. Write, optimize, and troubleshoot...: Strong proficiency with Apache Spark (DataFrames API, Spark SQL) using Scala or Python. Databases: Expert-level SQL skills. Extensive...
applications using Angular 20, HTML5, CSS3, and TypeScript. Building and integrating scalable backend services using Python... dashboards and data visualizations. Implementing and managing data pipelines and workflows using Apache Airflow...
& AI Engineering Hands on experience with DBT & Airflow & should be excellent with SQL Hands on experience with production use... of concurrent futures (ThreadPoolExecutor, ProcessPoolExecutor), subprocess management Hands on experience with Python...
and leading technical initiatives end‑to‑end. Nice to Have Python for data tooling, ETL/ELT jobs, data validation..., and automation (e.g., Pandas, SQLAlchemy, dbt adapters, Airflow operators). AWS (e.g., RDS/Aurora, Redshift, S3, Glue, Lambda, EMR...
. The ideal candidate will have strong expertise in Python-based automation, complex SQL querying, and validating large... testing and ETL/ELT workflow validation (Airflow or similar orchestration tools) Develop and maintain automation scripts...
consultant responsible for designing and delivering secure, scalable, and cost-efficient data platforms using Python, PySpark... of responsibility include but are not limited to: Design and implement Kafka producers/consumers (Python or JVM-based) with exactly...
like AirFlow or Cloud Workflows. Familiarity with Agile or other rapid application development methods. Hands on experience... with one or more programming languages (JavaScript, Java, Python, Scala). Knowledge of various Shell Scripting tools Strong communication...
to build, test, and support secure, scalable, and well-governed data pipelines. Firsthand experience in Airflow and PySpark... and strong knowledge of Python. Design and implement scalable and efficient data transformation/storage solutions using Snowflake...
Fusion, TERRAFORM, Tekton,Cloud SQL, AIRFLOW, POSTGRES, Airflow PySpark, Python, API Skills Preferred: Apache Kafka, Big..., DataPlex,DataFusion, Terraform, Tekton, Cloud SQL, Redis Memory, Airflow, Cloud Storage 2+ Years inData Transfer Utilities 2...
ETL pipelines using Airflow, Python, lambda, and glue. Design, execute, and ETL workflows, ensuring data integrity...
as assigned. Requirements We are looking for someone with: Datawarehouse, SQL, Snowflake, DBT, Python, AWS Glue, Fivetran... projects. Experience supporting, developing, and enhancing data pipelines using AWS Glue, Python and Snowflake. Proven...
as assigned. Requirements We are looking for someone with: Datawarehouse, SQL, Snowflake, DBT, Python, AWS Glue, Fivetran... projects. Experience supporting, developing, and enhancing data pipelines using AWS Glue, Python and Snowflake. Proven...
. Any programming language is fine with preference of Python Design and enforce data modelling standards (dimensional, normalized... Technical Skill Requirements Programming & Engineering Strong proficiency in Python (mandatory) Experience writing...
, Python and AWS, you will build scalable ELT pipelines and modern data products that drive measurable outcomes for teams..., FiveTran), Python and AWS ecosystems to deliver exceptional solutions. Collaborative Spirit: Work hand-in-hand with global...
Cloud Platform (GCP). Expertise in BigQuery for data warehousing and analytics. Experience with Apache Airflow... for workflow orchestration. Proficiency in Python or Java for data engineering tasks. Strong SQL skills for data modeling...
Required Skills Strong Python programming skills Good SQL knowledge Experience with large-scale data processing Git or similar... for distributed SQL querying Oracle database integration or data extraction Workflow tools such as Airflow or Oozie Experience...
of relevant experience; OR a Master's/PhD with 3+ years of relevant experience. Strong programming skills in Python... for grounded reasoning and citations. Experience with workflow engines/queues (e.g., Airflow, Temporal, Celery) and distributed...
languages such as Hive/Impala, Python, Kafka, PySpark etc. Responsibilities Drive the evolution of Data & Services products... proficiency in using Python, PySpark, SQL, Hadoop platforms to build Big Data products & platforms. Experience with performance...