The Resource Disrupting data discovery, Mark Grover, Tao Feng

Disrupting data discovery, Mark Grover, Tao Feng

Label
Disrupting data discovery
Title
Disrupting data discovery
Statement of responsibility
Mark Grover, Tao Feng
Creator
Contributor
Publisher
Subject
Language
eng
Summary
"Lyft has reduced the time it takes to discover data by 10x by building its own data portal, Amundsen. Amundsen is built on three key pillars: an augmented data graph, an intuitive user experience, and centralized metadata. Amundsen uses a graph database under the hood to store relationships between various data assets (tables, dashboards, protobuf events, etc.). What's unique to Amundsen is that it treats people as a first-class data asset; in other words, there's a graph node for each person in the organization that connects to other nodes (like tables, and dashboards). In addition, Amundsen runs PageRank using data from access logs to power search ranking, similar to how Google ranks web pages on the internet. Finally, Amundsen gathers metadata from various different sources (Hive, Presto, Airflow, etc.) and exposes it in one central place. The right place to store all this metadata is a work in progress. Mark Grover and Tao Feng (Lyft) offer a demo of Amundsen and lead a deep dive into its architecture, covering how it leverages centralized metadata, page rank, and a comprehensive data graph to achieve its goal. They also explore the future roadmap, unsolved problems, and its collaboration model. This session was recorded at the 2019 O'Reilly Strata Data Conference in San Francisco."--Resource description page
Cataloging source
UMI
Characteristic
videorecording
http://library.link/vocab/creatorName
Grover, Mark
LC call number
HD30.37
http://bibfra.me/vocab/relation/on-screenpresenter
  • paMz0l10ycw
  • Xq4oYZ2ZL5E
PerformerNote
Presenters, Mark Grover, Tao Feng
http://library.link/vocab/relatedWorkOrContributorName
  • Feng, Tao
  • O'Reilly (Firm)
Runtime
43
http://library.link/vocab/subjectName
  • Business enterprises
  • Decision making
  • Electronic data processing
  • Lyft (Firm)
  • Strata Conference
Technique
live action
Label
Disrupting data discovery, Mark Grover, Tao Feng
Link
http://databases.mvlc.org/connect/safari?uiCode=&xmlId=0636920340027
Instantiates
Publication
Note
Title from title screen (viewed January 20, 2020)
Carrier category
online resource
Carrier category code
  • cr
Carrier MARC source
rdacarrier
Color
multicolored
Configuration of playback channels
unknown
Content category
two-dimensional moving image
Content type code
  • tdi
Content type MARC source
rdacontent
Control code
on1137352838
Dimensions
unknown
Extent
1 online resource (1 streaming video file (42 min., 6 sec.))
Form of item
online
Media category
  • computer
  • video
Media MARC source
  • rdamedia
  • rdamedia
Media type code
  • c
  • v
Medium for sound
other
Other physical details
digital, sound, color
Sound
sound
Sound on medium or separate
sound on medium
Specific material designation
  • remote
  • other
Stock number
CL0501000091
System control number
(OCoLC)1137352838
Video recording format
other
Label
Disrupting data discovery, Mark Grover, Tao Feng
Link
http://databases.mvlc.org/connect/safari?uiCode=&xmlId=0636920340027
Publication
Note
Title from title screen (viewed January 20, 2020)
Carrier category
online resource
Carrier category code
  • cr
Carrier MARC source
rdacarrier
Color
multicolored
Configuration of playback channels
unknown
Content category
two-dimensional moving image
Content type code
  • tdi
Content type MARC source
rdacontent
Control code
on1137352838
Dimensions
unknown
Extent
1 online resource (1 streaming video file (42 min., 6 sec.))
Form of item
online
Media category
  • computer
  • video
Media MARC source
  • rdamedia
  • rdamedia
Media type code
  • c
  • v
Medium for sound
other
Other physical details
digital, sound, color
Sound
sound
Sound on medium or separate
sound on medium
Specific material designation
  • remote
  • other
Stock number
CL0501000091
System control number
(OCoLC)1137352838
Video recording format
other

Library Locations

    • Merrimack Valley Library ConsortiumBorrow it
      4 High Street, Suite 175, North Andover, MA, 01845, US
      42.7009413 -71.1255084
Processing Feedback ...