Data Engineering

Assistant Manager - Data Engineer

Noida, Uttar Pradesh
Work Type: Full Time

What job we expect you to do:

  • Connecting, designing, scheduling, and deploying data warehouse systems
  • Developing data pipelines and enable dash boards for stakeholders and
  • Develop, construct, test and maintain system architectures
  • Create best practices for data loading and extraction
  • Doing quick POCs for any data eccentric development task

What skills we expect you to bring:

  • Strong programing skills, being well versed in Object-Oriented Programming system (OOPS), data structures, and algorithms
  • Should be comfortable in executing ETL (Extract, Transform and Load) processes which include data ingestion, data cleaning and curation into a data warehouse, database, or data platform
  • Should be comfortable with schema designing
  • Experience in distributed computing environment
  • Experience in structured/unstructured data and batch processing/real-time processing (good to have)
  • Be comfortable with SQL (mandatory), Python(mandatory), Scala (good to have) to manipulate and prepare data and conduct various analysis as needed
  • Reading\writing data to\from various sources - APIs, cloud storage, databases, big data platforms
  • Experience of working with Big Data environment such as Hadoop and the ecosystem
  • Data transformations and applying ML models
  • Creating web services to allow create, read, update and delete (CRUD) operations
  • Competent in project management framework such as Agile
  • Excellent communication skills, both written and verbal

What expertise will bring added advantage?

  • Machine learning
  • Statistical Modelling
  • Natural Language Processing

What Tools and Technologies we expect you to know? We understand one cannot be master of all. 

  • Python - pandas, django\flask, sklearn, scikit
  • SQL, BigQuery
  • Hadoop ecosystems (HDFS, HIVE, Mapreduce, Pig, Spark, Hadoop etc.)
  • Kafka
  • Apache Spark
  • Linux
  • Airflow

How many years of experience you need? 

Minimum 4 years of relevant experience

Where will be the job location? 

We are ready to welcome you at Noida and Gurgaon and also open for any other location in India

Submit Your Application

You have successfully applied
  • You have errors in applying