For an international organization in New York, we are urgently looking for a Full Remote Senior Data Engineer with + 2 years Python and Azure Data Factory experience.
The Data Engineer will work under the supervision of the ICT Manager, Solution Engineering, and will play an integral role in the team to build solutions managing and organizing data as part of an exciting transformation to improve UNICEFs operations and systems. On a day-to-day basis, the person will actively work with the team on developing solutions and identifying ways to improve and build robust and integrated data infrastructure for UNICEF as well as data scientists, software developers, external partners and product owners.
Candidates need to be willing to work normal office hours in New York. This positions is long-term.
Tasks and responsibilities:
- Design, build and maintain data integration solutions and data management architecture;
- Build infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources;
- Collaborate with application teams in building data pipelines and solution architecture meeting the required data processing needs. Have objective and vision to create a truly open-source model for distributing the solution;
- Be responsible for implementing and ultimately expanding MVP system components so that subsystems function according to their solution architecture definitions;
- Under the guidance of database administrators, build and implement HA and DR for enterprise database systems using Failover Clustered Instances, Availability Groups, Multi-Site clusters and Replication.;
- Assist in housekeeping activities of database systems including building data pipelines and tools to reduce barriers, decrease manual testing and speed up delivery of data science as well as customer-facing;
- Follow established environmental change control processes for promoting changes from development to production, providing the team with guidance to ensure code can be scaled, standardized and, whenever possible, automated;
- Own issue solutions, root cause (Tier 3) analysis & problem solving;
- Document processes, procedures for completed solution to ensure continuity. Provide recommendations on near and long-term plans to improve efficiency and performance across products and implemented solutions;
Profile:
- University degree in Computer Science, Information systems management or related field;
- 5+ years of hands-on experience in software development, data engineering or data science field. developing and deploying integration solutions, with concrete understanding of core Microsoft Azure Integration Services to connect a mixture of on-premises, SaaS, and cloud-hosted applications.
- Experience supporting database and application architecture for deployment in hybrid cloud environments is a plus;
- 2+ years of experience in Python programming and developing solutions using serverless, low-code Azure Integration offerings including Azure Logic Apps, Azure Data Factory, and Azure Functions;
- 3+ years’ experience with SDLC/Agile methodologies and release management;
- Experience configuring MySQL,Mongo, PostgreSQL and/or Microsoft SQL Database systems;
- Proficient in SQL and NoSQL Database systems;
- CI/CD process leveraging ARM Templates and Azure DevOps, including git, DevOps pipelines and migrations from development to production environments;
- Deep understanding of large-scale, distributed systems;
- Experience with Big Data Technologies (Hadoop, Spark…);
- Good knowledge of Data formats as well as structured, unstructured storage, and orchestration tools in Docker Swarm or Kubernetes;
- Strong understanding of open API standards particularly, REST, SOAP and GraphQL, as well as ability to research develop, deploy and integrate with custom internal and third-party APIs. Knowledge of JSON, REST, and XML is a plus;
- Fluent in English;