Consultant – Data Engineering

Posted on


Practitioner / consultant

Job Summary

Join our seasoned team of Big Data, Cloud and Analytics professionals to take your career to the next level. You will be trained in technologies such as Amazon Web Services, SAS, Hortonworks Hadoop, Google Cloud Platform.

Responsibilities and Duties

  • Contribute to the job and data flow design on platforms like Big Query, Redshift, Hadoop, Snowflake, Teradata, Oracle etc.
  • Develop jobs using one or multiple given languages: HiveQL, Sqoop Jobs, Python, Spark SQL, SAS
  • Automation of Data Management jobs through different frameworks
  • Data ingestion to Hadoop or Cloud-based Data Lakes/Assets from various source systems
  • Documented business rules, functional and technical designs, test cases, and user guides

Education and Skills

  • Bachelor’s degree or higher in an Engineering, IT, Math or Science related field.
  • 6+ years of experience in which a minimum of 3+ years of professional Services (customer facing) experience, 3+ years in Hadoop/Spark ecosystem
  • Experience in Databricks will be a huge plus
  • Must have hands-on experience on one or more languages Spark SQL, Scala, Python, HiveQL etc.
  • Hands on experience on Airflow, NiFi or any other data orchestration tool
  • Should have a good understanding of data engineering project delivery
  • Experience on APIs like REST/JSON or XML/SOAP, Java ecosystem including debugging and monitoring tools
  • Strong verbal and written communications skills are a must
  • The ability to work effectively across internal and external organizations in different time zones


Durham, NC 27703


Milton Keynes

4th & 5th Floors, Ramky Grandiose, Gachibowli, Hyderabad- 500032, Telangana

All Rights Reserved . Core Compete Inc . Our site uses cookies to improve your experience. You can control cookies by adjusting your browser or device settings. By using our site and closing this box, you consent to our use of cookies.

More Information

Posted on


Practitioner / consultant


Hyderabad , India