Required: Programming: Python (priority), Java, Ab Initio, SAS, scripting. Data & Processing: AWS Glue, PySpark, Spark. Workflow... Orchestration: Airflow. Database & Querying: SQL, RDBMS (Teradata, Oracle). Cloud: AWS (cloud-native architectures). Automation...
services (S3, Glue, Lambda) or Azure services ( Blob Storage, ADLS gen2, ADF) Should have good experience in Python/Pyspark... experience and relevant as Senior Snowflake Data Engineer. Skill Metrix: Snowflake, Cortex AI, Python/PySpark, AWS/Azure, ETL...
and microservices architecture Hands-on development with Python, PySpark, SQL, and Power BI for reporting and visualization... and manage applications on AWS (Lambda, Glue, Athena, S3, ECS/Fargate, API Gateway) Build and maintain CI/CD pipelines...
: 2–8years Required Skills: Python (LangChain, FastAPI, OpenAI API, Databricks SDK) Strong SQL, PySpark, AWS Glue... and analytical logic. Develop and automate EDA/DQM checks (completeness, sparsity, outlier detection) using Databricks and AWS Glue...
, Redshift, Glue, Athena etc.,) Proficiency in Python, SQL, PySpark 4-5 years of post-degree professional experience as a data... warehouses, ETL/ELT, AWS architecture (using Glue, SQS, SNS, S3, step functions etc.,) Strong understanding of orchestration...
in Python, PySpark and SQL programming language for data manipulation and pipeline development. Hands-on experience with AWS... data from various sources into a centralized data platform. Develop and maintain ETL jobs using AWS Glue services...