Associate Big Data Engineer (Airflow/Python/Spark)

Job Description

Company: Nielsen Media India Private Limited
Job Type: Full-Time
Location: Bangalore, Karnataka, India
Job Category: Engineering
Expected Salary: ₹ 4 – 15 Lakh Per Annum
Experience: 0 – 2 Years

At Nielsen, we believe in fostering your career journey through collaboration and
empowerment. By joining our team of nearly 14,000 associates, you become part of a
supportive community dedicated to your success. We champion your aspirations because
your accomplishments are ours too. Embrace innovation, explore new avenues, and dare
to envision greatness, enabling us all to continuously evolve and improve. Let your
excellence propel our future.

About the Role

As an Associate Data Engineer, you’ll oversee data pipelines catering to both scheduled
and real-time use cases. Scheduled pipelines typically run in Airflow, while real-time
processing could involve Airflow or integrated querying in backend services.

Responsibilities

➢ Collaborate closely with team leads and backend developers to design and develop
functional, robust pipelines supporting internal and customer needs.
➢ Write unit and integration tests, and craft automation tools for daily tasks.
➢ Develop high-quality, well-documented, and efficient code.
➢ Manage and optimize scalable pipelines in the cloud.
➢ Optimize internal and external applications for performance and scalability.
➢ Create automated tests to ensure business needs are met, including unit,
integration, or data quality tests.
➢ Maintain regular communication with stakeholders, project managers, quality
assurance teams, and other developers regarding progress on the long-term
technology roadmap.
➢ Recommend systems solutions by evaluating the advantages and disadvantages of
custom development and purchased alternatives.

Key Skills (Domain Expertise)

➢ 0-2 years of experience as a software/data engineer.
➢ Bachelor’s degree in Computer Science, MIS, or Engineering.

Technical Skills Preferred

➢ Experience with database systems, including knowledge of SQL and NoSQL stores
(e.g., MySQL, Oracle, MongoDB, Couchbase, etc.).
➢ Participation in a team developing sophisticated data-driven software platforms.
➢ Familiarity with relational databases and/or analytical data stores (e.g., Spark,
Presto, Pandas).
➢ Contribution to the delivery and support of enterprise software.
➢ Experience with cloud service technologies, e.g., AWS.
➢ Proficiency with container technologies, e.g., Docker.
➢ Familiarity with source control systems, e.g., GIT.
➢ Information visualization skills.
➢ Knowledge of “big data” systems and analysis.
➢ Experience with data warehouses or data lakes.

Mindset and Attributes

➢ Strong communication skills, capable of conveying complex technical concepts and
aligning the organization on decisions.
➢ Sound problem-solving skills, able to quickly process complex information and
present it clearly and simply.
➢ Utilizes team collaboration to efficiently create innovative solutions.

How to Apply:

Interested candidates can apply for this position by clicking on the “Apply Now” button

Contact Information:

Company Website: Nielsen Website
Email: Email them
Contact Phone: Contact them