Web Data Commons - Feb 2012 Corpus - Format Development

The following tables show the development of the different structured data formats between the two web crawls analyzed so far. Since the crawls have different sizes, the relative differences between the percentages the formats over Domains, URLs, Typed Entities and Triples are given. To calculate the relavtive difference, we first calculate the percentage of each format of the total sum for each crawl and then subtract the results.

Domains with Triples


Extractor20102012? %
html-rdfa537,82016,976,23223.14%
html-microdata3,9303,952,6746.02%
html-mf-geo244,838897,0800.09%
html-mf-hcalendar226,279629,319-0.22%
html-mf-hcard12,502,50030,417,192-18.91%
html-mf-hlisting31,87169,569-0.06%
html-mf-hresume10,4199,890-0.04%
html-mf-hreview216,331615,681-0.19%
html-mf-species3,2444,109-0.01%
html-mf-hrecipe13,362127,3810.12%
html-mf-xfn5,323,33511,709,819-9.95%

URLs with Triples


Extractor20102012? %
html-rdfa14,314,03667,901,24626.28%
html-microdata56,96426,929,86514.22%
html-mf-geo5,051,6222,491,933-2.10%
html-mf-hcalendar2,747,2761,506,379-1.06%
html-mf-hcard83,583,16761,360,686-24.03%
html-mf-hlisting1,227,574197,027-0.73%
html-mf-hresume387,36420,762-0.25%
html-mf-hreview2,836,7011,971,870-0.87%
html-mf-species25,15814,033-0.01%
html-mf-hrecipe115,345422,2890.15%
html-mf-xfn37,526,63026,004,925-11.61%

Typed Entities


Extractor20102012? %
html-rdfa26,583,55849,370,7292.32%
html-microdata346,41190,526,0137.38%
html-mf-geo7,326,5164,787,126-0.08%
html-mf-hcalendar21,289,40227,165,5450.85%
html-mf-hcard973,170,050865,633,0597.89%
html-mf-hlisting25,660,4988,252,632-0.98%
html-mf-hresume1,501,00992,346-0.09%
html-mf-hreview8,234,8507,809,0880.11%
html-mf-species152,621139,6310.00%
html-mf-hrecipe695,8385,516,0360.41%
html-mf-xfn481,945,127163,271,544-17.80%

Triples


Extractor20102012? %
html-rdfa293,542,991456,169,1268.20%
html-microdata1,197,115404,413,91512.25%
html-mf-geo28,831,79511,222,766-0.21%
html-mf-hcalendar65,727,39365,547,8700.72%
html-mf-hcard3,226,066,0191,837,847,772-6.33%
html-mf-hlisting88,146,12220,703,189-1.07%
html-mf-hresume12,640,527432,363-0.23%
html-mf-hreview84,411,95150,475,411-0.09%
html-mf-species391,911224,847-0.00%
html-mf-hrecipe1,228,9255,513,0300.14%
html-mf-xfn1,391,091,386441,698,363-13.38%

Absolute Development

In this section, we directly compare the amount of Domains, URLs, Typed Entities and Triples for the different formats. However, since the two crawls have different sizes and contain different URLs, the following results should be taken with caution. The delta value is the newer value divided by the older value minus 1.

Domains with Triples


Extractor20102012?
html-rdfa537,82016,976,23230.56
html-microdata3,9303,952,6741004.77
html-mf-geo244,838897,0802.66
html-mf-hcalendar226,279629,3191.78
html-mf-hcard12,502,50030,417,1921.43
html-mf-hlisting31,87169,5691.18
html-mf-hresume10,4199,890-0.05
html-mf-hreview216,331615,6811.85
html-mf-species3,2444,1090.27
html-mf-hrecipe13,362127,3818.53
html-mf-xfn5,323,33511,709,8191.20

URLs with Triples


Extractor20102012?
html-rdfa14,314,03667,901,2463.74
html-microdata56,96426,929,865471.75
html-mf-geo5,051,6222,491,933-0.51
html-mf-hcalendar2,747,2761,506,379-0.45
html-mf-hcard83,583,16761,360,686-0.27
html-mf-hlisting1,227,574197,027-0.84
html-mf-hresume387,36420,762-0.95
html-mf-hreview2,836,7011,971,870-0.30
html-mf-species25,15814,033-0.44
html-mf-hrecipe115,345422,2892.66
html-mf-xfn37,526,63026,004,925-0.31

Typed Entities


Extractor20102012?
html-rdfa26,583,55849,370,7290.86
html-microdata346,41190,526,013260.33
html-mf-geo7,326,5164,787,126-0.35
html-mf-hcalendar21,289,40227,165,5450.28
html-mf-hcard973,170,050865,633,059-0.11
html-mf-hlisting25,660,4988,252,632-0.68
html-mf-hresume1,501,00992,346-0.94
html-mf-hreview8,234,8507,809,088-0.05
html-mf-species152,621139,631-0.09
html-mf-hrecipe695,8385,516,0366.93
html-mf-xfn481,945,127163,271,544-0.66

Triples


Extractor20102012?
html-rdfa293,542,991456,169,1260.55
html-microdata1,197,115404,413,915336.82
html-mf-geo28,831,79511,222,766-0.61
html-mf-hcalendar65,727,39365,547,8700.00
html-mf-hcard3,226,066,0191,837,847,772-0.43
html-mf-hlisting88,146,12220,703,189-0.77
html-mf-hresume12,640,527432,363-0.97
html-mf-hreview84,411,95150,475,411-0.40
html-mf-species391,911224,847-0.43
html-mf-hrecipe1,228,9255,513,0303.49
html-mf-xfn1,391,091,386441,698,363-0.68