platform, such as Hadoop or Spark Experience with data orchestration tools like Airflow is a nice to have Excellent problem...Title: Software Engineer Data Location: Austin-TX-78753(3 days on-site) Duration: 6 months We are seeking a highly...
in leveraging Apache Spark for large-scale data processing and advanced analytics, enabling both near real-time data insights... amounts) in/out of Hadoop Data lake. Architect, build, and launch new data pipelines and models that provide intuitive...
processing, NoSQL) 5+ years of experience in distributed, petabyte-scale data processing with Spark and container orchestration... for greater scalability. Architect, build, and optimize highly scalable data pipelines that incorporate complex transformations...
organization. Stay current with emerging technologies in data processing, distributed systems, and big data ecosystems... environments. Design and build real-time and batch data pipelines using Apache Flink and Apache Spark, supporting advanced data...
integrations, and the foundational Big Data infrastructure necessary for real-time personalization and predictive service. MLOPs... in coordinating the development of large-scale distributed systems or applications for data processing. Knowledge of technologies...