Ascend Learning, Inc.
Senior Big Data Engineer (Information Technology)
JOB DUTIES: Build and maintain data infrastructure and pipelines to support data and analytics, including quality, governance, lifecycle management, and compliance. Drive the architecture, design, and maintain data infrastructure and pipelines to support data and analytics, including quality, governance, lifecycle management, and compliance. Gather business and functional requirements from external and/or internal customers and end-users, and translate requirements into technical specifications to build robust, scalable, supportable solutions that work well between a range of complex systems. Serve as technical lead throughout the full development lifecycle, end-to-end, from scoping, planning, conception, design, implementation and testing, to documentation, delivery and maintenance. Create processes frameworks, design and implementation of large-scale data migration and data processing on Kafka, Spark, Hadoop and related platforms using parallel processing programming techniques. Analyze large amounts of data and help derive insights and value from them. Partner with data scientists to build an infrastructure/pipeline to collect and analyze data. Build tools for data scientists to access and use the platform. Mentor junior members of the data and analytics teams.
REQUIREMENTS: Bachelor's or foreign equivalent degree in Computer Science, Computer Engineering, Mathematics, Statistician or related field and Five (5) years of experience in the job offered or a related occupation. Experience must include three (3) years of experience with: building scalable data pipelines at multi-terabyte scale using at least four (4) big data technologies either Kafka, Hadoop, Spark, Hive, Streaming technologies or Zookeeper/Oozie; object-oriented design and development, data structures and algorithms or utilize Agile development methodologies/practices; Develop and implement Java application with standard UI components, or in Linux or Unix development environment; Create application architecture design and develop solutions to meet business requirements by leveraging knowledge across several platforms, processes, sub-modules and architectures to develop a technical solution; and develop data management tools: SQL/DBMS and NoSQL technologies like HBASE, Cassandra, Elastic Search.