We are looking for a seasoned Big Data data warehouse engineer. The candidate will build efficient big data data warehouse service to support various data applications that meet business needs.
Requirements5+ years experiences of data lake and data warehouse design and development experience.
Deeply understanding of data warehouse modeling and data governance. Solid knowledge of data warehouse development methodology, including dimensional modeling, information factory, and one data, etc.
Proficient in Java / Scala / Python (at least one language) and Hive & Spark SQL programming languages.
Familiar with OLAP technology (such as: kylin, impala, presto, druid, etc.).
Proficient in Big Data batch pipeline development.
Familiar with Big Data components including but not limited to Hadoop, Hive, Spark, Delta lake, Hudi, Presto, Hbase, Kafka, Zookeeper, Airflow, Elasticsearch, Redis, etc.
Experiences with AWS Big Data services are a plus.
Clear mind, with good business requirement understanding, analysis, abstraction, and system design capabilities.
Have a strong team collaboration attitude and develop partnerships with other teams and businesses.
Those who have experienced data volume above PB level in Internet companies and solve difficult production issues are preferred.
Be optimistic, able to adapt quickly to meet new challenges, and quick to respond to incidents