–Supplementary Material–AViD Dataset: Anonymized Videos from Diverse

Countries

AJ PiergiovanniIndiana University

ajpiergi@indiana.edu

Michael S. RyooStony Brook University

mryoo@cs.stonybrook.edu

A Diversity Statistics Collection

In order to find the country location for each video in previous YouTube-based datasets(e.g., Kinetics, HACS, etc.), we used the public YouTube API. Specifically, usinghttps://developers.google.com/youtube/v3/docs/videos, we extracted the ‘recordingDetails.location’object. Importantly, it notes that

‘The geolocation information associated with the video. Note that the child propertyvalues identify the location that the video owner wants to associate with the video.The value is editable, searchable on public videos, and might be displayed to usersfor public videos.’

This is the only location data YouTube publicly provides and many videos in existing datasets do nothave this field. In our measure, roughly 8% of the videos had such geolocation. We then used reverse-geocode library https://pypi.org/project/reverse-geocode/ to map the coordinates to the country, thenmanually mapped the countries to each region.

For full transparency, we provide detailed breakdowns of the diversity data we were able to measurewith these tools in Table 1 as an example.

Country Video Count

North America 32,767EU 1,613

Latin America 2,289Asia 938

Africa 37

No Location 422,645Table 1: Kinetics-400 Video Distribution

B Difference to Kinetics Numbers

After the initial version of AViD was released (on arXiv), the Kinetics team provided numbers basedon the estimated upload location of the video (this metadata is not publicly available) (Smaira et al.,2020).

In the paper, we have included their diversity statistics as well, as they are more complete, representing90% of videos, compared to about 8% that we were able to get geolocation for.

34th Conference on Neural Information Processing Systems (NeurIPS 2020), Vancouver, Canada.

ReferencesL. Smaira, J. Carreira, E. Noland, E. Clancy, A. Wu, and A. Zisserman. A short note on the kinetics-700-2020

human action dataset, 2020.

C Action Classes

1. abseiling

2. acoustic guitar

3. acrobatic gymnastics

4. acting in play

5. adjusting glasses

6. aerobics

7. air drumming

8. air travel

9. airbrush

10. alligator wrestling

11. alpine climbing

12. alpine skiing

13. amusement park

14. answering questions

15. applauding

16. applying cream

17. archaeological excavation

18. archery

19. arguing

20. arm wrestling

21. arranging flowers

22. arresting

23. assembling bicycle

24. assembling computer

25. attending conference

26. auctioning

27. baby transport

28. baby waking up

29. backflip (human)

30. backpacking (wilderness)

31. baking

32. baking cookies

33. balance beam

34. balloon blowing

35. bandaging

36. barbell

37. barbequing

38. bartending

39. base jumping40. bathing41. bathing dog42. batting (cricket)43. batting cage44. battle rope training45. beatboxing46. bee keeping47. belly dancing48. bench pressing49. bending back50. bending metal51. biceps curl52. bicycling53. biking through snow54. blasting sand55. blending fruit56. blowing glass57. blowing leaves58. blowing nose59. blowing out candles60. bmx bike61. boating62. bobsledding63. body piercing64. bodyboarding65. bodysurfing66. bodyweight exercise67. bookbinding68. bottling69. bouncing ball70. bouncing ball (not juggling)71. bouncing on bouncy castle72. bouncing on trampoline73. bowling74. bowling (cricket)75. braiding hair76. breading or breadcrumbing77. breakdancing78. breaking

2

79. breaking boards80. breaking glass81. breathing fire82. brush painting83. brushing hair84. brushing teeth85. building cabinet86. building lego87. building sandcastle88. building shed89. bull fighting90. bulldozer91. bulldozing92. bungee jumping93. burping94. busking95. buttoning96. cake decorating97. calculating98. calligraphy99. camping

100. canoeing or kayaking101. capoeira102. caporales103. capsizing104. card stacking105. card throwing106. card tricks107. carp fishing108. carrying baby109. carrying weight110. cartwheeling111. carving ice112. carving marble113. carving pumpkin114. carving wood with a knife115. casting fishing line116. catching fish117. catching or throwing baseball118. catching or throwing frisbee119. catching or throwing softball120. celebrating121. changing gear in car122. changing oil

123. changing wheel124. chasing125. checking tires126. checking watch127. cheerleading128. chiseling stone129. chiseling wood130. chopping meat131. chopping vegetables132. chopping wood133. christmas134. circus135. clam digging136. clay pottery making137. clean and jerk138. cleaning floor139. cleaning gutters140. cleaning pool141. cleaning shoes142. cleaning toilet143. cleaning windows144. climbing a rope145. climbing ladder146. climbing tree147. closing door148. coloring in149. combat150. comedian151. concert152. construction153. contact juggling154. contorting155. cooking156. cooking chicken157. cooking egg158. cooking on campfire159. cooking sausages160. cooking sausages (not on barbeque)161. cooking scallops162. cooking show163. cosplaying164. counting money165. country line dancing166. cracking knuckles167. cracking neck

3

168. crawling baby169. cricket170. crocheting171. crossing river172. crouching173. crying174. cumbia175. curling (sport)176. curling hair177. cutting apple178. cutting cake179. cutting nails180. cutting orange181. cutting pineapple182. cutting watermelon183. dancing184. dancing ballet185. dancing charleston186. dancing gangnam style187. dancing macarena188. dashcam189. deadlifting190. dealing cards191. decorating the christmas tree192. decoupage193. delivering mail194. demolition195. digging196. dining197. directing traffic198. dirt track racing199. disc golfing200. disc jockey201. diving cliff202. docking boat203. dodgeball204. dog agility205. doing aerobics206. doing jigsaw puzzle207. doing laundry208. doing nails209. doing sudoku210. doing wheelie211. drag racing

212. drawing213. dressage214. dribbling basketball215. drifting (motorsport)216. drinking217. drinking beer218. drinking shots219. driving car220. driving tractor221. drooling222. drop kicking223. drumming fingers224. dumbbell225. dump truck226. dumpster diving227. dune buggy228. dunking basketball229. dying hair230. eating burger231. eating cake232. eating carrots233. eating chips234. eating doughnuts235. eating hotdog236. eating ice cream237. eating nachos238. eating spaghetti239. eating street food240. eating watermelon241. egg hunting242. electric guitar243. embroidering244. embroidery245. enduro246. entering church247. exercising arm248. exercising with an exercise ball249. explosion250. extinguishing fire251. extreme sport252. faceplanting253. falling off bike254. falling off chair255. feeding birds256. feeding fish

4

257. feeding goats258. building fence259. fencing (sport)260. festival261. fidgeting262. field hockey263. figure skating264. filling cake265. filling eyebrows266. finger snapping267. fingerboard (skateboard)268. firefighter269. fireworks270. fixing bicycle271. fixing hair272. flamenco273. flint knapping274. flipping bottle275. flipping pancake276. fly tying277. flying kite278. folding clothes279. folding napkins280. folding paper281. forklift282. french horn283. front raises284. frying285. frying vegetables286. gambling287. garbage collecting288. gardening289. gargling290. geocaching291. getting a haircut292. getting a piercing293. getting a tattoo294. giving or receiving award295. gliding296. go-kart297. gold panning298. golf chipping299. golf driving300. golf putting

301. gospel singing in church302. greeting303. grinding meat304. grooming cat305. grooming dog306. grooming horse307. gymnastics308. gymnastics tumbling309. hammer throw310. hand washing clothes311. head stand312. headbanging313. headbutting314. heavy equipment315. helmet diving316. herding cattle317. high fiving318. high jump319. high kick320. hiking321. historical reenactment322. hitchhiking323. hitting baseball324. hockey stop325. holding snake326. home improvement327. home roasting coffee328. hopscotch329. horse racing330. hoverboarding331. huddling332. hugging333. hugging (not baby)334. hugging baby335. hula hooping336. hunting337. hurdling338. hurling (sport)339. ice climbing340. ice dancing341. ice fishing342. ice skating343. ice swimming344. inflating balloons345. installing carpet

5

346. ironing347. ironing hair348. javelin throw349. jaywalking350. jetskiing351. jogging352. juggling353. juggling balls354. juggling fire355. juggling soccer ball356. jumping357. jumping bicycle358. jumping into pool359. jumping jacks360. jumping sofa361. jumpstyle dancing362. karaoke363. kick (football)364. kickboxing365. kickflip366. kicking field goal367. kicking soccer ball368. kissing369. kitesurfing370. knitting371. krumping372. land sailing373. landing airplane374. laughing375. lawn mower racing376. laying bricks377. laying concrete378. laying decking379. laying stone380. laying tiles381. leatherworking382. letting go of balloon383. licking384. lifting hat385. lighting386. lighting candle387. lighting fire388. listening with headphones389. lock picking

390. logging391. long jump392. longboarding393. looking at phone394. looking in mirror395. luge396. lunge397. making a cake398. making a sandwich399. making balloon shapes400. making bed401. making bubbles402. making cheese403. making horseshoes404. making jewelry405. making latte art406. making paper aeroplanes407. making pizza408. making snowman409. making sushi410. making tea411. making the bed412. manicure413. manufacturing414. marching415. marching band416. marimba417. marriage proposal418. massaging back419. massaging feet420. massaging legs421. massaging neck422. mechanic423. metal detecting424. metal working425. milking cow426. milking goat427. minibike428. mixing colours429. model building430. monster truck431. moon walking432. mopping floor433. mosh pit dancing434. motocross

6

435. motorcycling436. mountain biking437. mountain climber (exercise)438. moving baby439. moving child440. moving furniture441. mowing lawn442. mushroom foraging443. musical ensemble444. needle felting445. news anchoring446. news presenter447. nightclub448. none449. offroading450. ollie (skateboarding)451. omelette452. opening bottle453. opening bottle (not wine)454. opening coconuts455. opening door456. opening present457. opening refrigerator458. opening wine bottle459. orchestra460. origami461. outdoor recreation462. packing463. parade464. paragliding465. parasailing466. parkour467. passing american football468. passing soccer ball469. peeling apples470. peeling banana471. peeling potatoes472. penalty kick (association football)473. person collecting garbage474. personal computer475. petting animal476. petting animal (not cat)477. petting cat478. petting horse

479. photobombing480. photocopying481. picking apples482. picking blueberries483. picking fruit484. pilates485. pillow fight486. pinching487. pipe organ488. pirouetting489. planing wood490. planting trees491. plastering492. playing accordion493. playing american football494. playing badminton495. playing bagpipes496. playing banjo497. playing basketball498. playing bass guitar499. playing beer pong500. playing billiards501. playing blackjack502. playing cards503. playing cello504. playing checkers505. playing chess506. playing clarinet507. playing controller508. playing cricket509. playing cymbals510. playing darts511. playing didgeridoo512. playing dominoes513. playing drums514. playing fiddle515. playing field hockey516. playing flute517. playing gong518. playing guitar519. playing hand clapping games520. playing handball521. playing harmonica522. playing harp523. playing ice hockey

7

524. playing keyboard525. playing kickball526. playing laser tag527. playing lute528. playing mahjong529. playing maracas530. playing marbles531. playing monopoly532. playing netball533. playing oboe534. playing ocarina535. playing organ536. playing paintball537. playing pan pipes538. playing piano539. playing piccolo540. playing pinball541. playing ping pong542. playing poker543. playing polo544. playing recorder545. playing road hockey546. playing rounders547. playing rubiks cube548. playing rugby549. playing saxophone550. playing scrabble551. playing shuffleboard552. playing slot machine553. playing snare drum554. playing soccer555. playing squash or racquetball556. playing tennis557. playing timbales558. playing trombone559. playing trumpet560. playing tuba561. playing ukulele562. playing viola563. playing violin564. playing volleyball565. playing with toys566. playing with trains567. playing xylophone

568. plumbing569. poaching eggs570. poking bellybutton571. pole vault572. polishing furniture573. polishing metal574. popping balloons575. pouring beer576. pouring milk577. pouring wine578. praying579. preacher580. preparing salad581. presenting weather forecast582. pretending to be a statue583. protesting584. pull ups585. pulling586. pulling espresso shot587. pulling rope588. pulling rope (game)589. pumping fist590. pumping gas591. punching bag592. punching person593. push up594. pushing car595. pushing cart596. pushing wheelbarrow597. pushing wheelchair598. putting on foundation599. putting on lipstick600. putting on sari601. putting on shoes602. putting wallpaper on wall603. queuing604. racing605. radio-controlled model606. rafting607. rain608. rallying609. reading book610. reading newspaper611. recipe612. recording music

8

613. recreational fishing614. repairing puncture615. riding a bike616. riding camel617. riding elephant618. riding mechanical bull619. riding mule620. riding or walking with horse621. riding scooter622. riding snow blower623. riding unicycle624. ripping paper625. roasting626. roasting marshmallows627. roasting pig628. robot dancing629. rock climbing630. rock scissors paper631. rocking632. roller coaster633. roller skating634. rolling pastry635. rope pushdown636. rowing (sport)637. running638. running on treadmill639. sailing640. salsa dancing641. saluting642. sanding floor643. sanding wood644. sausage making645. sawing wood646. scrambling eggs647. scrapbooking648. screen printing649. scrubbing face650. scuba diving651. seasoning food652. separating eggs653. serve (tennis)654. setting table655. sewing656. shaking hands

657. shaking head658. shaping bread dough659. sharpening knives660. sharpening pencil661. shaving head662. shaving legs663. shearing sheep664. shining flashlight665. shining shoes666. shooting basketball667. shooting off fireworks668. shopping669. shot put670. shouting671. shoveling snow672. shredding paper673. shrugging674. shucking oysters675. shuffling cards676. shuffling feet677. side kick678. sieving679. sign language interpreting680. silent disco681. singing682. sipping cup683. situp684. skateboarding685. ski ballet686. ski jumping687. skiing crosscountry688. skiing mono689. skiing slalom690. skipping rope691. skipping stone692. sky diving693. skydiving694. slacklining695. slapping696. sled dog racing697. sleeping698. slicing onion699. slopestyle700. smashing701. smelling feet

9

702. smoking703. smoking hookah704. smoking pipe705. smoothie706. snatch weight lifting707. sneezing708. sniffing709. snorkeling710. snowboarding711. snowkiting712. snowmobile713. snowmobiling714. snowplow715. snowshoe716. soccer goal717. somersaulting718. sowing719. speed skating720. spelunking721. spinning plates722. spinning poi723. splashing724. splashing water725. spray painting726. spraying727. springboard diving728. square dancing729. squat730. squeezing orange731. stacking cups732. stacking dice733. standing on hands734. standup paddleboarding735. staring736. stealing737. steer roping738. steering car739. sticking tongue out740. stir frying741. stirring742. stomping grapes743. street racing744. stretching745. stretching arm

746. stretching leg747. strumming guitar748. stunt performer749. submerging750. sucking lolly751. sun tanning752. surfing crowd753. surfing water754. surveying755. sweeping floor756. swimming757. swimming backstroke758. swimming breast stroke759. swimming butterfly stroke760. swimming front crawl761. swimming with dolphins762. swimming with sharks763. swing dancing764. swinging baseball bat765. swinging legs766. swinging on something767. sword fighting768. sword swallowing769. tabla770. tackling771. tagging graffiti772. tai chi773. taking a shower774. taking photo775. talking on cell phone776. tango dancing777. tap dancing778. tapping guitar779. tapping pen780. tasting beer781. tasting food782. tasting wine783. teaching784. tearing785. telemark ski786. tennis787. testifying788. texting789. threading needle790. throwing axe

10

791. throwing ball792. throwing ball (not baseball or american

football)793. throwing discus794. throwing knife795. throwing snowballs796. throwing tantrum797. throwing water balloon798. thunderstorm799. tickling800. tie dying801. tightrope walking802. tiptoeing803. tobogganing804. torte805. tossing coin806. tossing salad807. train808. training dog809. trapezing810. treating wood811. trimming or shaving beard812. trimming shrubs813. trimming trees814. triple jump815. twiddling fingers816. tying bow tie817. tying knot (not on a tie)818. tying necktie819. tying shoe laces820. tying tie821. unboxing822. uncorking champagne823. underwater diving824. unidentified flying object825. unloading truck826. using a microscope827. using a paint roller828. using a power drill829. using a sledge hammer830. using a wrench831. using atm832. using bagging machine833. using circular saw

834. using computer835. using inhaler836. using megaphone837. using puppets838. using remote controller839. using remote controller (not gaming)840. using segway841. vacuum cleaner842. vacuuming car843. vacuuming floor844. valuting845. visiting the zoo846. volcano847. wading through mud848. wading through water849. waiting in line850. wakeboarding851. waking up852. walking on stilts853. walking the dog854. walking through snow855. walking with crutches856. washing857. washing dishes858. washing feet859. washing hair860. washing hands861. washing machine862. watching tv863. water park864. water skiing865. water sliding866. watercolor painting867. waterfall868. waterfowl hunting869. watering plants870. waving hand871. waxing armpits872. waxing back873. waxing chest874. waxing eyebrows875. waxing legs876. weaving basket877. weaving fabric878. wedding879. weight lifting

11

880. welding881. whistling882. wildlife883. windsurfing884. winking885. wood burning (art)886. wood carving887. woodworking

888. wrapping present

889. wrestling

890. writing

891. yarn spinning

892. yawning

893. yoga

894. zumba

D Full Hierarchy

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

Figure 1: Full AViD hierarchy

34