REAL-WORLD DRIVER BEHAVIOR DATA COLLECTION This limited data set has been collected in Istanbul with the instrumented vehicle called "UYANIK" within the framework of "Drive-Safe Consortium" in Turkey and sponsored in part by NEDO International Collaborative Research Project (Japan). Users of Istanbul, Nagoya and Dallas data sets are expected to acknowledge the following three works, respectively: [1] H. Abut, H. Erdogan, A. Ercil, et al., “Data collection with “UYANIK”: too much pain; but gains are coming,” Chapter 3 in Corpus and Signal Processing for Driver Behavior, K. Takeda, J. H.L. Hansen, H. Erdoğan, and H. Abut, (eds.) Springer Business-Science, 2008. [2] C. Miyajima, T. Kusakawa, T. Nishino, N. Kitaoka, K. Itou, K. Takeda, “On-Going Data Collection of Driving Behavior Signals,” Chapter 4 in Corpus and Signal Processing for Driver Behavior, K. Takeda, J. H.L. Hansen, H. Erdoğan, and H. Abut, (eds.) Springer Business-Science, 2008. [3] P. Angkititrakul, J.H.L. Hansen, “UTDrive: The smart vehicle project,” Chapter 5 in Corpus and Signal Processing for Driver Behavior, K. Takeda, J. H.L. Hansen, H. Erdoğan, and H. Abut, (eds.) Springer Business-Science, 2008.. The complete Istanbul data set consisting of 84 male and 17 female drivers is available from the Drive-Safe Consortium of Turkey. A tool called In-Vehicle Multimode Corpus has been developed, which is capable of displaying multiple videos, multiple audio channels, CAN-Bus readings. It is also possible to compress the data several formats including MPEG4 using the DivX codecs. The primary feature of the tool is the multi-mode, multi-level transcription capability including the transcription of Driving Actions, Driver's Phyiscal State, Driver's Emotional State, Environment Conditions (road, weather, traffic, pedestrian) from the video and Driver Congitive load from the audio including on-line banking using ASR. As an example a movie has been created in .avi format to demonstrate the on-banking transcription. In this movie, a male driver is checking over the mobile phone the prices of four stocks traded in Istanbul Stock Market by calling an ASR based on-line banking access number. If the name of the stock has been correctly recognized then the female operator announces the latest value of that particular stock. If the ASR is not successful in recognizing the stock name then a male operator asks for repeat of the process. Information and shortcut notation about data in each data directory: Channel Information: V1 - Video facing the driver (DivX AVI, 15 fps, 480x640) V3 - Video facing the road (DivX AVI, 15 fps, 480x640) A1 - Driver close-talking microphone (16 KhZ, 16-bit .wav format) A2 - Rearview microphone (far field) (16 KhZ, 16-bit .wav format) A4 - Cellular phone microphone (16 KhZ, 16-bit .wav format) M1 - CAN-Bus (32 hz, txt format) M2 - GPS (32 hz, raw format) M3 - IMU (32 hz, txt format) M4 - Laser (1 Hz, 181 X-Y coordinates in cm, txt format) CAN Bus Data: SWA Steering wheel angle (degrees) SWRS Steering wheel relative speed (degrees/second) VS Vehicle speed (km/h) WSFR Wheel speed front right (km/h) WSFL Wheel speed front left (km/h) WSRR Wheel speed rear right (km/h) WSRL Wheel speed rear left (km/h) PGP Percent gas pedal (% in) ERPM Engine RPM (rpm) NS Gear neutral or not (0/1) YR Yaw rate CS Clutch state (0/1) RG Reverse gear (0/1) BS Break state (0/1) CM Clutch (0/1) Record-Time Milliseconds from the beginning of the recording Date Time Hours, minutes, seconds, milliseconds ADC1 Break pedal pressure sensor (kilogram-force per centimeter square (kgf/cm2) (1.0 kgf=9.8 Newtons) ADC2 Gas pedal pressure sensor(kilogram-force per centimeter square (kgf/cm2) (1.0 kgf=9.8 Newtons) Data Directory Notation: All videos are avi format at 15 frames per second, 480x640; all audios are 16 Khz, 16-bit wav format I M 3 0 1 2 (/AS/M/V) │ │ │ │ └"": main data directory; "AS": synchronized audio data; "M": other data; "V": synchronized audio/video file │ │ │ └─ n-th demo drive of the driver (ex.: "2"-th demo drive) │ │ │ ___ │ │ │ └─── 2 digit driver ID │ │ └──── 1 digit dataset ID │ └───── "M": male driver; "F": female driver └────── always "I" for data collected in Istanbul Data directory listing (without files): . ├───IF3041 │ ├───IF3041AS │ ├───IF3041M │ └───IF3041VA ├───IF3042 │ ├───IF3042AS │ ├───IF3042M │ └───IF3042VA ├───IF3051 │ ├───IF3051AS │ ├───IF3051M │ └───IF3051VA ├───IF3052 │ ├───IF3052AS │ ├───IF3052M │ └───IF3052VA ├───IM3011 │ ├───IM3011AS │ ├───IM3011M │ └───IM3011VA ├───IM3012 │ ├───IM3012AS │ ├───IM3012M │ └───IM3012VA ├───IM3013 │ ├───IM3013AS │ ├───IM3013M │ └───IM3013VA ├───IM3021 │ ├───IM3021AS │ ├───IM3021M │ └───IM3021VA ├───IM3022 │ ├───IM3022AS │ ├───IM3022M │ └───IM3022VA ├───IM3031 │ ├───IM3031AS │ ├───IM3031M │ └───IM3031VA └───IM3032 ├───IM3032AS ├───IM3032M └───IM3032VA Data directory listing (with files): . │ channel_information.txt │ ├───IF3041 │ ├───IF3041AS │ │ IF3041AS1.wav │ │ IF3041AS2.wav │ │ IF3041AS4.wav │ │ │ ├───IF3041M │ │ M1.raw │ │ M2.raw │ │ M3.raw │ │ M4.raw │ │ │ └───IF3041VA │ IF3041V1A1.avi │ IF3041V3A4.avi │ ├───IF3042 │ ├───IF3042AS │ │ IF3042AS1.wav │ │ IF3042AS2.wav │ │ IF3042AS4.wav │ │ │ ├───IF3042M │ │ M1.raw │ │ M2.raw │ │ M3.raw │ │ M4.raw │ │ │ └───IF3042VA │ IF3042V1A1.avi │ IF3042V3A4.avi │ ├───IF3051 │ ├───IF3051AS │ │ IF3051AS1.wav │ │ IF3051AS2.wav │ │ IF3051AS4.wav │ │ │ ├───IF3051M │ │ M1.raw │ │ M2.raw │ │ M3.raw │ │ M4.raw │ │ │ └───IF3051VA │ IF3051V1A1.avi │ IF3051V3A4.avi │ ├───IF3052 │ ├───IF3052AS │ │ IF3052AS1.wav │ │ IF3052AS2.wav │ │ IF3052AS4.wav │ │ │ ├───IF3052M │ │ M1.raw │ │ M2.raw │ │ M3.raw │ │ M4.raw │ │ │ └───IF3052VA │ IF3052V1A1.avi │ IF3052V3A4.avi │ ├───IM3011 │ ├───IM3011AS │ │ IM3011AS1.wav │ │ IM3011AS2.wav │ │ IM3011AS4.wav │ │ │ ├───IM3011M │ │ M1.raw │ │ M2.raw │ │ M3.raw │ │ M4.raw │ │ │ └───IM3011VA │ IM3011V1A1.avi │ IM3011V3A4.avi │ ├───IM3012 │ ├───IM3012AS │ │ IM3012AS1.wav │ │ IM3012AS2.wav │ │ IM3012AS4.wav │ │ │ ├───IM3012M │ │ M1.raw │ │ M2.raw │ │ M3.raw │ │ M4.raw │ │ │ └───IM3012VA │ IM3012V1A1.avi │ IM3012V3A4.avi │ ├───IM3013 │ ├───IM3013AS │ │ IM3013AS1.wav │ │ IM3013AS2.wav │ │ IM3013AS4.wav │ │ │ ├───IM3013M │ │ M1.raw │ │ M2.raw │ │ M3.raw │ │ M4.raw │ │ │ └───IM3013VA │ IM3013V1A1.avi │ IM3013V3A4.avi │ ├───IM3021 │ ├───IM3021AS │ │ IM3021AS1.wav │ │ IM3021AS2.wav │ │ IM3021AS4.wav │ │ │ ├───IM3021M │ │ M1.raw │ │ M2.raw │ │ M3.raw │ │ M4.raw │ │ │ └───IM3021VA │ IM3021V1A1.avi │ IM3021V3A4.avi │ ├───IM3022 │ ├───IM3022AS │ │ IM3022AS1.wav │ │ IM3022AS2.wav │ │ IM3022AS4.wav │ │ │ ├───IM3022M │ │ M1.raw │ │ M2.raw │ │ M3.raw │ │ M4.raw │ │ │ └───IM3022VA │ IM3022V1A1.avi │ IM3022V3A4.avi │ ├───IM3031 │ ├───IM3031AS │ │ IM3031AS1.wav │ │ IM3031AS2.wav │ │ IM3031AS4.wav │ │ │ ├───IM3031M │ │ M1.raw │ │ M2.raw │ │ M3.raw │ │ M4.raw │ │ │ └───IM3031VA │ IM3031V1A1.avi │ IM3031V3A4.avi │ └───IM3032 ├───IM3032AS │ IM3032AS1.wav │ IM3032AS2.wav │ IM3032AS4.wav │ ├───IM3032M │ M1.raw │ M2.raw │ M3.raw │ M4.raw │ └───IM3032VA IM3032V1A1.avi IM3032V3A4.avi