Data Engineer – Data Engineering Support Services
Duties
- Data Extraction, Transformation and Loading. Tasks include: extracting data from input files, transforming data according to the necessary formats and loading data into the Repository platform.
- Ensuring smooth data flow into Pledge data analysis model.
- Maintaining the current data pipelines and developing new data pipelines to incorporate new sources of data.
- Data Modelling and Data Views creation. Tasks include: Work with the Repository team to understand requirements for analysis and visualization.
- Develop and optimize data models and data views that allow for analysis of all relevant aspects of the data.
- Working with the Pledge team to create an interactive portal/data model to facilitate analysis of Allied returns.
- Data quality and validation. Tasks include: Support the data analyst in cleaning and standardising data from external sources (Repository and Pledge).
- Identifying inconsistencies, gaps, and missing elements in the data and flagging these to the data analyst and the project manager (PM).
- Support the Repository/Pledge teams on technical choices. Tasks include: Investigate potential tools for data processing, data integration and visualization that could be used in a NATO environment.
- Advising the team on technical choices by clearly communicating the options to a non-technical audience.
- Generation of Analytical Insights for NATO Leadership. Tasks include: Support the data analyst in producing analytical products by creating dashboards and visual analytics.
- Potentially also use large language models to extract insights from unstructured data.
- Documentation and information sharing. Tasks include: Document data pipelines, codes and data models.
- Information sharing with the team and onboarding of new team members.
Requirement
- 2 years experience working as a Data Engineer or in a similar role.
- Professional experience in planning and executing the data science lifecycle / data pipelines, including ingestion, pre-processing, quality assurance, analysing, post-processing and visualisation.
- Proficiency in Python for data processing.
- Knowledge of ArcGIS software.
- Very good written and spoken English.
- The candidate must have a NATO SECRET security clearance.
- The contractor must be in possession of a security clearance of NATO Secret.
- Strong analytical and technical skills.
- Proactive and highly detail-oriented.
- Ability to work collaboratively within a multi-disciplinary team and to communicate technical information to non-technical audiences.
Preferences
- Proficiency in ArcGIS API for Python.
- Professional experience in configuring an ArcGIS Enterprise portal and its applications, such as ArcGIS Experience Builder, ArcGIS Dashboards, ArcGIS Notebooks, Survey123, and Workflow Manager, with preferred basic knowledge of ArcGIS Pro.
- Experience in visualization and building of web applications.
- Knowledge of NATO networks and data engineering/analysis tools available on those networks.
- Ability to work with both structured and unstructured data.
- Ability to work with both structured and unstructured data. Experience from using large language models to analyse text data.
- Experience with cyber-security data analysis.