Requirements
5+ years experiences of developing big data related applications
Proficient in Java language, familiar with Spring framework, and Micro-service architecture
Proficient in big data pipeline development including batch and streaming processing
Familiar with big data components like Hadoop, Hive, Spark, Spark streaming, Flink, Presto, Hbase, Kafka
Experience in big data product development is a plus, including data warehouse, query platform, streaming, recommendation, user profiling, risk management, etc
Love working in a team, good analytical skill, willing to accept challenges and quick in resolving problems
Develop and maintain data engineering systems across the data lifecycle, including data pipelines for batch and streaming applications
Develop APIs to support high throughput data processing, feature engineering, risk algorithms and data science use cases
Develop data quality monitoring and alert systems to ensure high availability and high quality data sources
Design and upgrade of data architecture to support new data applications, technical enhancements and business requirements
