We are looking for a Big Data Engineer that will work on the collecting, storing, processing, and analyzing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company.

Responsibilities

Big Data Engineer job description should contain the following duties and responsibilities:

• Responsible for Hadoop development
• Implementation including loading from disparate data sets, preprocessing using Hive and Pig.
• Scope and deliver various Big Data solutions
• Ability to design solutions independently based on high-level architecture.
• Manage the technical communication between the survey vendor and internal systems
• Maintain the production systems (Kafka, Hadoop, Cassandra, Elastic search)
• Collaborate with other development and research teams
• Building a cloud based platform that allows easy development of new applications
• Experience with Php (Laravel, Codeigniter, Yii,REST/SOAP)
• Experience with non-relational & relational databases (SQL, MySQL, NoSQL, Hadoop, MongoDB, etc.)