Data Engineer

Data Engineer


Introduction: Require an ambitious individual who can work under your own direction towards agreed targets and goals, have the ability to manage change and to work under stress. Should be curious to learn as demonstrated by his/her up-to-date technical knowledge. Should be a good team player and familiar with Agile methodologies and principles and/or have experience working in an Agile team. We seek an applicant who will thrive in an open, dynamic, flexible, fun, spirited, collaborative environment; an individual who desires creative freedom and the opportunity to work in a high performing team.

Your Roles and Responsibilities:

  1. work closely with business stakeholders to understand their goals and determine how data can be used to achieve those goals.
  2. Design data modelling processes, create algorithms and predictive models to extract the data the business needs, then help analyze the data and share insights with peers
  3. Browse and analyze enterprise databases to simplify and improve product development, marketing techniques, and business processes
  4. Create custom data models and algorithms
  5. Use predictive models to improve customer experience, ad targeting, revenue generation, and more
  6. Develop the organization’s test model quality and A/B testing framework
  7. Coordinate with various technical/functional teams to implement models and monitor results
  8. Develop processes, techniques, and tools to analyze and monitor model performance while ensuring data accuracy
  9. Work on State-of-the-Art cloud technologies provided by client Public Cloud, RedHat, AWS & others.
  10. Be part of open, transparent agile teams who always thrive for continuous learning and contribute towards continuous improvement.

Required Skills:

Primary Skills-Spark, Scala, Kubernetes, Python, SQL, Airflow

Secondary Skills-ETL,Datastage,DB2

  1. A natural inclination toward solving complex problems
  2. Knowledge/experience on/with statistical programming languages, including Scala, Python, SQL, etc., to process data and gain insights from it
  3. Knowledge of using and developing data architectures
  4. Knowledge of Machine Learning techniques, including decision tree learning, clustering, artificial neural networks, etc., and their pros and cons will be preferable.
  5. Knowledge and application experience in advanced statistical techniques and concepts, including, regression, distribution properties, statistical testing, etc.
  6. Good communication skills to promote cross-team collaboration
  7. Impulse to learn and master new technologies
  8. Multilingual coding knowledge/experience: Java, JavaScript, C, C++, etc.
  9. Experience/knowledge on ETL tool, preferably Datastage.
  10. Experience with major web services, including S3, Spark, Redshift, etc.
  11. Experience/knowledge in distributed data and computing tools, including, MapReduce, MySQL, Hadoop, Spark, Hive, etc.
  12. Ability to use data visualization tools to showcase data for stakeholders using D3, ggplot, Periscope, and more

Preferred Skills:

ü Represents skills that are an advantage or desired to have

ü Do not list mandatory skills or copy-paste from the Required expertise section

Job Location: Bangalore
Job Function: Technology