The Dataset

Main parts of the event

The dataset was recorded during 3 different events. During each, an equal number of people of each gender participated: 16 for the first day and 15 for the second and third, for a total of 92 participants.

Each event was separated in 2 main parts: the speed dates (about 1 hour) and the mingle (about 50min each day for which 30 are annotated).

Speed Dates

Each participant had a 3-minute date with a participant of the opposite sex, in a space set for that purpose in a public bar. Each date was followed by approximately 1 minute to fill their match booklet. Once completed, all participants of the same sex were asked to move to the next seat. This rotation was repeated until all participants have met all participants of the opposite sex.

Below are example screen shots of the speed events and the booklet given to each participant.

Mingle (cocktail party)

During this part, participants were asked to mingle freely within the area limited for this purpose. Participants were not instructed in any way, and could move through, leave and re-enter the mingle area at will. Drinks and snacks were available.

The sensors and survey responses

Overview of sensors and survey responses included in the dataset:

Wearable sensors

Participants were given a custom-made device (smart badge) that was to be hung around the neck, emulating a badge similar to those used in conferences, and to be worn for the duration of the event.

These devices recorded:

  • Tri-axial acceleration at 20Hz.
  • Binary proximity between devices using wireless communication.

All data between the devices is synchronized using wireless communication, and to the cameras using time mapping.

 

 

Video cameras

A total of 9 GoPro Hero +3 silver cameras recorded the event from above. All cameras were synchronized using the GoPro remote, and recorded at 30FPS with a resolution of 1080. There is some overlapping between adjacent cameras.

Survey responses

HEXACO (personality inventory)

Before the event, all participants filled the HEXACO inventory. This survey assess the traits of Honesty, Emotionality, eXtraversion, Agreeableness, Conscientiousness, and Openness to experience. All item questions, scores and sub-scores are available.

Date responses

All participants filled their impressions about their date directly after their interaction. They give a score (0=low, 7=high) for the questions:

  • How much would you like to see this person again?
  • How would you rate this person as a potential friend?
  • How would you rate this person as a potential sexual partner?
  • How would you rate this person as a potential romantic partner?

They also state if this is the first time they talk to the person.

Manual annotations

There are three main annotations for MatchNMingle: Position on video, F-Formations and Social actions.

  • Position: bounding boxes for the position of the people at 20FPS for a 30 minute segment during the mingle.
  • F-Formation: group formation, under the F-Formation concept described by Adam Kendon, for a 10 minute segment of the mingle. This segment overlaps with the 30 minute annotation for the position. Annotations every second.
  • Social actions: annotations for walking, stepping (changing your weight from one leg to other in the same place), speaking, hand gestures, head gestures, drinking, laughing, and hair touching. These are done for the same 30 minute segment as the positions, at 20FPS.

Due to financial limitations, the annotations were carried out in two phases, resulting on two versions:

Mingle: Version 1

Only 2 cameras per day were annotated. Thus, some participants were not under the field of view of any camera. This version is available for comparison and reproducibility purposes.

Mingle: Version 2

Three cameras per day were annotated. These cameras contained the higher density of people, and assure that all participants had at least 70% of the 30 minute segment annotated for. We recommend this version of the dataset.

 

Collection procedure

As participants entered the venue, they were assigned an anonymized participant number and then provided a wearable device.

During the preparation process, researchers collected frontal photos of one group (either the men or the women), while collecting hair samples of the other group (for hormone baselines). During the break after the 7th speed date, the groups were reversed so that hair samples and photos could be taken. For example, if during registration photos were taken of the women and hair samples were taken from the men, during the break photos were taken of men and hair samples were taken from women. After the speed dates, there was a second break where any remaining hair samples and photos were collected.

Speed dates

The first part of the event was the speed dates. Each participant had an approximately 3-minute date with a participant of the opposite sex, followed by approximately 1 minute to fill their match booklet. Once completed, all participants of the same sex were asked to move to the next seat. For the rotation process, we alternated the sex that was asked to move so as to prevent confusion and regulate first impressions. This rotation was repeated until this portion of the event was complete. Approximately half-way through the speed-dating session (after the 7th date), we introduced a pause to reduce the effect of fatigue on participants’ impressions.

Mingle

For the second part of the event the participants were asked to mingle freely within the area limited for this purpose. This area was limited to ensure high spatial density of people during the mingle. Participants were not instructed in any way, and could move through, leave and re-enter the mingle area at will.

Important notes

  • Women and men were separated during the entire preparation process to ensure that their first encounter occurred during the speed dates.
  • Participants of opposite sex remained separated during all breaks.
  • During the mingle, soft and/or alcoholic drinks were provided (2 for free with the option of purchasing more) in the bar or by request to one of our team members. 5 Snacks were also available for purchase.
  • During speed dates, only water was provided.