Workpackages

Co-ordination

The aim of this WP is to coordinate the implementation of the project as set out in the work plan. ULB will be responsible for organising internal meetings between the partners of the project to report on progress and between the partners and external members of the project, the follow up committee and international contacts. The coordinator will be responsible for controlling that the achieved work is in line with the timetable and giving feedback to partners.

The general co-ordination of the project will be undertaken by ULB and RBINS. ULB is the overall scientific co-ordinator and will be responsible for coordinating biomechanical and ICT development. RBINS will be the Anthropological co-ordinator and will be responsible for the coordination of all anthropological aspects of the project, including maintaining efficient communication channels between end-users (mainly, anthropologists, archaeologists) and the development partners (including biomechanics specialist, IT specialists); this role is of the highest importance to ensure the development will answer the needs of the end users and will be optimally translated into user-friendly tools. The two co-ordinators will meet every fortnight.

The scientific committee will consist of a representative of each partner plus the two co-ordinators, and will meet each month. Meeting minutes will be produced after each meeting in order to better track project progress and to foresee any delay from the original work plan. The follow up committee will also be invited to join these meetings.

Task 1.1 Project Coordination – TL: ULB

• Overall project coordination including ensuring the initial work plan is respected, chairing the internal partners meetings (fortnightly meetings between ULB and RBINS, monthly meetings between members of Scientific Committee), follow up committee meetings and anticipating delays and proposing alternatives to the project to the Scientific Committee for discussion

• Liaison between BELSPO services and the project partners. Ensuring effective communication of administrative tasks and issues within the partners.

• Ensure proper communication and coordination between partners, WPs, the follow up committee and other external contacts.

Task 1.2 Project Reporting – TL: RBINS

• Creation and maintenance of the website of the project on the RBINS Scientific Service Heritage Plone server.

• Production and consolidation of periodic external reports. Work plan maintenance, monitoring of progress, timely production and adherence to quality procedures to deliver projects output.

• Production and consolidation of cost-statements

This workpackage will focus on a review of the current literature on measurements, analysis and visualisation tools and will identify the tools necessary for effective palaeoanthropological study.

Task 2.1 Review of the literature – TL: RBINS

This task will focus on an exhaustive review of the literature related to available digital tools and in existing software to find out what is currently available and what is missing in the palaeoanthropological field in term of measurements, analysis of fossil hominids and visualisation tools.

Task 2.2 Definition of User Specification – TL: RBINS

Digital tools for viewing and analysis of virtual objects (including taking both simple and complex measurements) are crucial for scientists and curators. However, integrated Open Source analysis tools for this purpose are mostly lacking. The partners in this consortium previously developed a specific analysis tool for biomedical applications called lhpFusionBox. They demonstrated that this tool can be tailored partially towards the needs of palaeoanthropology or other disciplines. In this WP, further conceptual and software development will be planned to extend the lhpFusionBox software towards the current needs of palaeoanthropologists working with fossil remains and digital objects. RBINS will work closely with MHNH to define the analysis and visual tools required for this cultural heritage domain. Members of the follow up committee and contacts from the International networks of the partners will also be invited to define the required tools.

This task deliverable will be a detailed and well-documented document that will describe user needs and will be utilised in Task 2.3 to define the technical specifications that will guide the development of the novel methodologies and scientific tools requested.

Task 2.3. Definition of Technical Specification – TL: VUB

Task 2.2 will lead to a document detailing the specifications of the tools required. This document will then be used by the partners VUB and ULB to write the technical specifications needed to develop further software code based on the user requirements. Software will be implemented in C++, Phyton and C#. Based on current needs, the software will be developed in four domains and are described in separate tasks below (3.1, 3.2, 3.3 and 3.4). 

Task 3.1. Creation of practical field operation – TL: VUB

There are many independent operations that exist in the current version of the lhpFusionBox but they were aimed towards an engineering public, which is similar to other modelling software (OpenSim, AnyBody, LifeMod). In previous projects and studies it was noted that many of the routine operations for anthropologists and archaeologists are composed of a long sequence of simple independent operations in lhpFusionBox, making the use of the current version very repetitive and prone to errors due to operator fatigue from having to frequently repeat the same sequences of operations. Task 2.2. will identify the most difficult and complex operations. This task will then concentrate on creating a set of practical script-like operations directly usable in the field by palaeoanthropologists and archaeologists, mainly by aggregating already existing operations into new ones. A potential strategy could be to implement a scripting or macro mechanism to simplify or repeat complex operations. This approach has clear advantages over developing specific operations for each user domain as it allows the domain experts to extend the functionality themselves, and to perform scientific operations in an as automated manner as possible.

Task 3.2. Development and implementation of novel measurement tools in lhpFusionBox – TL: ULB

In task 2.2. RBINS will work together with the MHNH to identify measurements to be implemented into lhpFusionBox which will be better suited to (palaeo)anthropological and forensic sciences requirements, and the analysis of the digitised (fossil) bones. This will start with the analysis of the physical anthropologist Martin’s measurements (as they are measurements which are most often used in (palaeo)anthropology. This will ensure that analytical studies produced in the virtual environment can be compared to previous similar research and will therefore be of the most interest to other researchers. RBINS will then work with ULB and VUB to analyse the suitability of implementing already prototyped methods into lhpFusionBox, such as the automated modelling of joint and bone morphology using primitive objects (such as sphere, ellipse, quadric surfaces, etc. as detailed in the methods).

Task 3.3. Development of new import formats and visualisation of textured objects in lhpFusionBox – TL: VUB

One of the limitations of the actual version of lhpFusionBox is that the software is not able to display 3D models with a colour texture in the same way as other software viewers such as Meschscan. The visualisation of Cultural Heritage objects is thus limited. lhpFusionBox will be adapted to visualise and allow the importation of a textured file such as PLY and/or OBJ files. This will be defined according to task 2.2 and also according to compatibility with other software. This task will also examine how to manage visualisation and analysis of multispectral acquisitions which would be of significant use to other digitised cultural heritage collections. lhpFusionBox is able to align multiple models in the same space. It is thus possible in theory to use the software to display multispectral acquisitions of the same object and to switch from one view to another using the same reference system and one set of landmarks. This will enable the comparison of different acquisitions of the models and enable users to evaluate differences between the models.

Task 3.4 Development of wrapping method – TL: ULB

The project aims to develop a novel methodology of muscle wrapping around joints. This is justified by the fact it is still an unsolved challenging topic in the musculoskeletal modelling field, and by extension in (palaeo)anthropology. A more effective wrapping methodology that is coherent with real musculoskeletal behaviour would be of high value and give more accurate insight into musculoskeletal physiology compared to current tools and would allow an accurate modelling of muscular movement of fossil individuals. A feasibility study on muscle wrapping was previously performed on the reconstructed Spy II skeleton and despite the fact that preliminary results were promising; it also demonstrated the limits of current methods and the need to develop more optimal musculoskeletal wrapping tools and models.

Task 3.5 User testing of new tools implemented in lhpFusionBox – TL: RBINS

In order to maximise the fit between the developed software modules and the requirements from the domain(s), a user-centred design methodology is adopted in this WP. It entails continuous testing by the actual users, not only with respect to assessing technical correctness, but also with respect to relevancy of the proposed methods and the ease of user interactions. RBINS will also invite MHNH, members of the follow up committee and contacts from their International network to assist with testing the software. VUB, ULB and RBINS will then regularly meet to discuss the evaluation of newly incorporated features. A bug tracking system will be established by VUB to keep track of the various bugs and feature requests. In order to ease user testing and software updates, a web based software auto updating mechanism will be put in place as well.

Task 3.6 Documentation and training material for lhpFusionBox – TL: RBINS/ULB

In line with the rationale behind all the other work in this WP, we want to provide the domain users with all possible help to be able to use the software package as easily as possible. A first version of a user manual for the current version of lhpFusionBox is currently maintained by ULB. This document will be extended with new features to include the new aspects of lhpFusionBox. The guide will also include appropriate references for biomechanical analyses performed. VUB will ensure the user manual is easily accessible from within the software itself. The online manual will also be available on the website of the project hosted by RBINS.

WP4 Non-contact reproduction of Cultural heritage Objects – WPL: RBINS

Current developments in scanning and 3D printing technologies enables the production of high resolution 3D objects (< 50 µm) based on the virtual model. Non-contact production is a unique opportunity to create a high resolution duplication without using casting products (silicone and polyurethane resin) which can damage the original object and/or are toxic for users. Another limitation of classical moulding reproduction is the smaller size of the replica (reproductions can be up to 2% smaller). The 3D digitisation/3D printing offers a great potential for scientific purpose, curation aspects and valorisation. This project will use the RBINS fossil hominids collection to evaluate the potential of this new method of reproduction for the different applications and establish best practices which can be (re)used for other collections. In the case of fossil hominids, 3D digitisation also provides a virtual backup of the specimen before destructive sampling (e.g. for radiocarbon dating or palaeogenomic and isotopic studies). The non-contact 3D reproduction opens up new opportunities for studying, learning about and disseminating Cultural Heritage objects, including human remains.

Task 4.1 Evaluation of the virtual reproduction of physical objects – TL: RBINS

In this task, RBINS and MNHN will compare the level of detail and the resolution/accuracy of the digital reproduction in comparison with the classical moulding protocol. Best practices will be established for the use of this new approach in the routine activities of the RBINS and other Federal Scientific Institutions. This will include following the evolution of the physical object through time and different preservation conditions and making 3D reproductions before restoration or destructive sampling.

Task 4.2 Preparing the 3D models for an easy and accurate 3D printing – TL: RBINS

• ADIA and RBINS will examine the digitised fossils in the collection and decide which fossils have the most priority to be placed on the website and corrected for 3D printing

• The models will be then be evaluated and corrected with the open source software GOM Inspect and Meshmixer to insure that there are no there are no errors in the models.

• Each 3D model will then be printed in order to ensure that no problem occurs during the 3D printing.

Task 4.3 Creation of a digital space network of non-contact moulds – TL: RBINS

RBINS and ADIA will work to create a digital space which will enable the digitised fossils to be easily produced in 3D. This digital space of non-contact moulds will also be accompanied by information on the fossil which will be of pedagogical use. RBINS will upload all the fossils from the digital collection chosen from task 4.2 onto Sketchfab. RBINS and ADIA will also add information markers on the 3D models of the fossils where necessary.

The aim of this WP is to create an International website based on Neandertals. The website will be created by ADIA in conjunction with RBINS and the new state of the art research in Neandertals being performed at VUB and ULB will be incorporated into the website. An experienced half time graphic designer will work with ADIA to create the website and to incorporate 3D models in the website.

Task 5.1 Content of the website – TL: ADIA

ADIA and RBINS will work on the content of the website. This document will then be the basis for the development of the new website. The document will be validated by RBINS scientists (anthropologists, archaeologists, palaeontologists and geologists) and by teachers. The follow up committee will also be invited to evaluate the website.

Task 5.2 Scenario – TL: ADIA

ADIA will create the scenario and prepare the storyboard. This will include creating a document to detail the structure of the website, menus and submenus and will detail how the different pages will link to each other using a mind mapping approach. This document will then be the basis for the new website. This scenario will be submitted to the follow up committee.

Task 5.3 Text writing and collection of documents – TL: ADIA

ADIA will write the text which will accompany the website and prepare the documents to upload to the website.

Task 5.4 Creation and design of the website – TL: ADIA

• ADIA will work on the creation and design of the website. It will follow the graphic chart defined by the graphic designer of RBINS for the Gallery of Human Evolution exhibition hall. ADIA was also involved in the creation of the Gallery of Human Evolution

• The new website will also be linked with the RBINS website.

Task 5.5 Upload and integration of the 3D models and animation on the Sketchfab platform – TL: RBINS

• Each model will be uploaded onto the Sketchfab platform and checked for quality control

• Each model will also be prepared (quality of the model, background, light, default texture, labels)

• Models will be organised in Sketchfab through a series of folders

Task 5.6 Testing of the rendering and interactions – TL: ADIA

In this task, the rendering of the 3D models/animations will be evaluated on different devices (screens, tablets, mobile phones).

Task 5.7 Translation in Dutch and English – TL: ADIA

The initial website prototype will be in French. ADIA and RBINS will then work with native English and Dutch speakers to produce the text of the website in Dutch and English. 

The aim of this WP is to create a Neandertal Avatar based on the Spy II skeleton and to use that avatar in computer games for both educational purposes for school children taking part in the animations by ADIA and for use in serious gaming. The avatar will also be used in the project website.

Task 6.1 Preparation of the reconstructed skeleton - TL: VUB

RBINS will transfer the high resolution models to VUB for pre-processing in order to make the model suitable for use in computer games. This means that the models will be converted into lower resolution models that can be loaded into the Unity 3D Engine. Some models, such as the Neandertal model, are naked and do not have body hair. Hence, the model will be fitted with clothes and hair in order to increase the possibilities for using the models in games for younger children. The VUB will work with RBINS and ADIA to determine the best choice for the appearance such as hair colour, eye colour etc. based on current scientific research.

Task 6.2. Identification of gaming scenarios for specific age groups for educational purposes – TL: ADIA

ADIA will work with all other partners and the member of the follow up committee Vincent Patar, to identify specific scenarios for the developed games. The idea is that the developed game will consist of small challenges or mini-games which will be used in the animations for ADIA. In each of these mini-games, the Neandertal will interact with other species (e.g. mammoths) and for each of those game characters, the game will provide age-adapted additional information specifically targeted at the different age groups. One game will also provide some insight into the activities and daily life of a palaeoanthropologist. Similar to other animations by ADIA, we anticipate scenarios in which the children need to investigate basic scientific issues. For instance, children can use the game to investigate whether Neandertals are taller than us? They can locate the femur, learn to measure it with a digital ruler (as in lhpFusionBox) and compare the lengths of the femur of the Neandertal skeleton and a contemporary skeleton.

Task 6.3. Analysis which existing serious games to use for the developed Neandertal avatar – TL: RBINS

The suite of games available at ULB and VUB will be examined for their success and potential suitability to add a Neandertal avatar to by all partners. As an example, the following description is of the “Hit The Rocks” game. This game simply asks the patient to throw a ball in the direction of a pile of blocks. This game is actually practicing balance and trunk control in the patient group as they can change the orientation of the ball by means of trunk movements. This game can be directly translated into a hunting game (for example, by throwing rocks towards mammoths), clearly enriching the game experience of the patients.

Task 6.4 Development of tablet games - TL: VUB

The games will then be developed by VUB using the Unity 3D Game Engine according to the scenarios developed in Task 5.2. The technological platform used for the development of these games enables the distribution of these games on Android, iOS and Windows based mobile platforms via the respective app stores. During the project, the feasibility of this will be investigated.

Task 6.5 Incorporation of the 3D models into rehabilitation games - TL: VUB

This work package will concentrate on the incorporation of the avatar developed in Task 5.1 into existing serious games defined as the most suitable in task 5.2.

Task 6.6 Game evaluation - TL: ADIA

All developed gaming material needs to be evaluated continuously by the involved stakeholders. ADIA will run an animation based on the new game. Children in the target group will be observed during game play and interviewed by means of structured questionnaires in order to understand whether the provided information in the games is actually correct, whether it is attractive to the children and whether the game mechanics are providing sufficient reward to explore the full game and hence to maximise the potential information transfer. 

The aim of the project is to target different audiences with a view to valorising the digitised fossils. Press releases will be sent out when different parts of the project are completed. RBINS will work closely with the communication department and will send the press releases to the communication departments of ULB, RBINS and VUB who will then send the press releases to the relevant media.

Task 7.1 Dissemination to University students and scholars – TL: RBINS

The new tools developed in lhpFusionBox will be of significant interest to palaeoanthropologists as well as anatomists, medical students and students working on comparative morphology studies, measurements, musculoskeletal models and biomechanics. The new tools will be highlighted through a press release detailing the availability of the tools, which will be released with the assistance of the network of the RBINS communication department. RBINS will attend high level conferences such as the European Society of Human Evolution conference in Year 1 and 2 to give feedback on the development of the tools and the availability of the fossils. Results of the outcomes of the project will also be published in peer reviewed international journals.

Task 7.2 Dissemination to schools and museums on virtual casting – TL: RBINS

The availability of the fossils will be highlighted on the website and on the RBINS website. When the fossils are available for download on the site, media stations and schools and museums will be contacted to tell them of the project and the fact that rare and important fossils which are important pedagogical materials are available for free download. The education department at RBINS will be able to assist with the provision of a mailing list of both relevant schools and museums and the network of journalists from the communication department at the RBINS will be used. Whilst the target for this is schools and museums, anyone with an interest in human evolution will be able to download the fossils.

Task 7.3 Dissemination to electronic visitors – TL: RBINS

The creation of a website on Neandertals will enable more electronic visitors to view the digitised fossils. The more media coverage that is generated from the project, the more electronic visitors will visit the website. It is therefore important that media coverage is not done too early so that the fossils are complete.

Task 7.4 Dissemination to medical patients – TL: ULB

ULB and VUB are specialists in serious gaming. They are currently working on different projects in serious gaming and the avatar will be incorporated into their long standing projects.

Task 7.5 Dissemination via Sketchfab and the creation of a Blog – TL: ADIA

RBINS will work with the head of business development in Sketchfab to provide the maximum amount of exposure to the online community. There is a dedicated museums page with over 350 museums. The RBINS is already a part of this community and the homepage of RBINS will be updated to include much more information and provide a showcase for the digitised fossils. RBINS will also write a blogpost detailing the reconstructed skeleton and the progress of the project. This will be shared via Sketchfab through their website, newsletter and social channels.