Skip to content

Apple India Careers for Big Data Engineer

    Website Apple

    Job Description:

    Our team collaborates deeply with partners across product and design, engineering, and business teams. Our mission is to drive innovation by providing the business and data scientist partners outstanding systems and technology, to make decisions that improve the customer experience of using our services. This will include demonstrating large data sources, helping derive meaningful insights, delivering multifaceted, and bringing our data to life via amazing visualizations.


    Job Responsibilities:

    • Work hand in hand with the DevOps team and develop monitoring and alerting scripts on various data pipelines and jobs
    • Build scalable data sets from available raw data and derive business metrics/insights
    • Develop Python and Shell Scripts for data ingestion from external data sources for business insights
    • Understand and identify server APIs that need to be instrumented for analytics reporting and align the server events for execution in already established data pipelines
    • Process, clean and validate the integrity of data used for analysis
    • Translate business requirements by business team into data and engineering specifications
    • Work with engineering and business partners to define and implement the data engagement relationships required with partners
    • Explore and understand data sets, identify and formulate correlational rules between heterogeneous data sources

    Job Requirements:

    • Knowledge on Scala and Splunk are good to have
    • Expertise in Python, Unix Shell scripting and Dependency driven job schedulers
    • Expertise in Core JAVA, Oracle, Teradata and ANSI SQL
    • Familiarity with rule based tools and APIs for multi stage data correlation on large data sets is a plus
    • Understanding on various distributed file formats such as Apache AVRO, Apache Parquet and common methods in data transformation
    • Familiarity with Apache Oozie and PySpark
    • Ability to understand API Specs, identify relevant API calls, extract data and implement data pipelines & SQL friendly data structures
    • Identify and execute Data Validation rules and alerts based on data publishing specifications for data integrity and anomaly detection

    Qualification & Experience:

    • 5+ years of professional experience with big data systems, data pipelines and processing
    • Practical hands-on experience with technologies like Apache Hadoop, Apache Pig, Apache Hive, Apache Sqoop & Apache Spark
    • Minimum of bachelor’s degree, preferably in Computer Science, Information Technology or EE, or relevant proven expertise is helpful.

    Job Details:

    Company: Apple

    Vacancy Type: Full Time

    Job Location: Mumbai, Maharashtra, IN

    Application Deadline: N/A