History of ego_social
The changes to the source code of this entry in the repository, newest first, each with the differences it made to the entry's files. They are also listed on GitLab.
[entries] Remove superfluous details of the upstream distribution from the descriptions dc07aa0
The descriptions mentioned incidental details of how the upstream data are made available: the file formats (CSV, JSON, XML, GEXF, SBML, HIF, Pajek, UCINET, ...), file names, where the files were published or obtained from (Zenodo, figshare, Kaggle, the Pajek datasets page, the Internet Archive), and that some networks are only available in the gt format. These are left out; caveats about the data themselves are kept, referring to "the data" instead of "the file". The description of sp_baboons now lists its properties instead of the upstream columns, and says that events without a recipient are left out.
diff --git a/entries/ego_social/__init__.py b/entries/ego_social/__init__.py
index aa17188..9f4366e 100644
--- a/entries/ego_social/__init__.py
+++ b/entries/ego_social/__init__.py
@@ -36,7 +36,7 @@ The networks have the following properties:
- (Node) `name` (ego networks): the identifier of the user.
- (Node) `feat` (ego networks): the binary feature vector of the user.
-- (Node) `circles` (ego networks): the list of circles of the ego to which the user belongs, each identified by its index (starting from 0) in the circles file of the source data.
+- (Node) `circles` (ego networks): the list of circles of the ego to which the user belongs, each identified by its index (starting from 0) in the list of circles of the ego in the source data.
- (Graph) `feat_names` (ego networks): a dictionary mapping each position of the feature vector to the name of the feature (e.g. `gender:1` or `birthday;anonymized feature 0`)."""
tags = ['Social', 'Online', 'Unweighted', 'Metadata']
url = ['https://snap.stanford.edu/data/egonets-Facebook.html',
[entries] Add the date when each entry was added, and remove icon_hash beff7c9
The dates are those of the commits that first added the entries' files (2020-08-11 for the entries of the initial commit); renamed entries keep the date of their first name. Changed: none
diff --git a/entries/ego_social/__init__.py b/entries/ego_social/__init__.py
index 6644bb3..aa17188 100644
--- a/entries/ego_social/__init__.py
+++ b/entries/ego_social/__init__.py
@@ -43,7 +43,7 @@ url = ['https://snap.stanford.edu/data/egonets-Facebook.html',
'https://snap.stanford.edu/data/egonets-Gplus.html',
'https://snap.stanford.edu/data/egonets-Twitter.html']
citation = [('J. McAuley and J. Leskovec. "Learning to Discover Social Circles in Ego Networks." NIPS (2012). arxiv:1210.8182', 'http://arxiv.org/abs/1210.8182')]
-icon_hash = '56a85c8e26855e083a2f78b0'
+date_added = '2020-08-11'
upstream_license = None
upstream_prefix = 'https://snap.stanford.edu/data'
files = [((f'facebook.tar.gz:facebook/{d}.edges', f'facebook.tar.gz:facebook/{d}.feat',
[entries] Prefix the properties in the descriptions with (Node), (Edge) or (Graph) bc3dbbd
The lists of properties at the end of the descriptions marked edge properties with "Edge" but left node properties unmarked, or grouped them in "Nodes: `a`, ...; `b`, ..." items, so the kind of a property was often unclear. Every item now starts with (Node), (Edge) or (Graph), followed by the property names, a colon and the explanation, one item per property or group of properties; qualifications (kinds of nodes, networks) follow the names in parentheses. Properties that were only named got a short explanation, and a few items that named the wrong kind of property were corrected.
diff --git a/entries/ego_social/__init__.py b/entries/ego_social/__init__.py
index 366e187..6644bb3 100644
--- a/entries/ego_social/__init__.py
+++ b/entries/ego_social/__init__.py
@@ -34,8 +34,10 @@ Nodes are users. In Facebook, an undirected edge means that the two users are fr
The networks have the following properties:
-- Nodes (ego networks): `name`, the identifier of the user; `feat`, the binary feature vector of the user; `circles`, the list of circles of the ego to which the user belongs, each identified by its index (starting from 0) in the circles file of the source data.
-- Graph (ego networks): `feat_names`, a dictionary mapping each position of the feature vector to the name of the feature (e.g. `gender:1` or `birthday;anonymized feature 0`)."""
+- (Node) `name` (ego networks): the identifier of the user.
+- (Node) `feat` (ego networks): the binary feature vector of the user.
+- (Node) `circles` (ego networks): the list of circles of the ego to which the user belongs, each identified by its index (starting from 0) in the circles file of the source data.
+- (Graph) `feat_names` (ego networks): a dictionary mapping each position of the feature vector to the name of the feature (e.g. `gender:1` or `birthday;anonymized feature 0`)."""
tags = ['Social', 'Online', 'Unweighted', 'Metadata']
url = ['https://snap.stanford.edu/data/egonets-Facebook.html',
'https://snap.stanford.edu/data/egonets-Gplus.html',
[entries] Remove unneeded code from the entries 2c69f19
Unneeded "global files" statements, unused imports and variables, f-strings without placeholders, duplicate keys in foodweb_little_rock (keeping the order and the values used), and the second definition of get_lines() in twitter_higgs. Nothing changes in the networks or descriptions. Changed: none
diff --git a/entries/ego_social/__init__.py b/entries/ego_social/__init__.py
index c2fdd9c..366e187 100644
--- a/entries/ego_social/__init__.py
+++ b/entries/ego_social/__init__.py
@@ -282,7 +282,6 @@ def fetch_upstream(force=False):
@coerce_props()
@annotate()
def parse(alts=None):
- global files
name = __name__.split(".")[-1]
for fnames, alt, fmt in files:
if alts is not None and alt not in alts:
[entries] ego_social: add the Twitter ego networks 8847dd3
The entry had only the Facebook and Google+ ego networks of McAuley and Leskovec; the Twitter ego networks of the same data set (973 networks and their union) were left out. They are added, with their features (hashtags and mentions) and circles, as for Google+. Changed: upstream ego_social
diff --git a/entries/ego_social/__init__.py b/entries/ego_social/__init__.py
index c68c8b8..c2fdd9c 100644
--- a/entries/ego_social/__init__.py
+++ b/entries/ego_social/__init__.py
@@ -19,16 +19,18 @@
from .. import *
title = "Ego networks in social media (2012)"
-description = """Ego networks of users of Facebook and Google+, collected by J. McAuley and J. Leskovec to study how users organize their friends into social circles. An ego network consists of the friends of a user (the ego) and the connections among them, where the ego is not included as a node. The Facebook data were collected from survey participants through a Facebook app, and include the users' manually labeled circles (friend lists). The Google+ data were crawled in 2012 from users who had manually shared their circles using the "share circle" feature. Node features (profile information) are given as binary vectors; for Facebook, the feature values have been anonymized, so that only the kind of feature (e.g. `birthday`, `education;school;id`) can be identified.
+description = """Ego networks of users of Facebook, Google+ and Twitter, collected by J. McAuley and J. Leskovec to study how users organize their friends into social circles. An ego network consists of the friends of a user (the ego) and the connections among them, where the ego is not included as a node. The Facebook data were collected from survey participants through a Facebook app, and include the users' manually labeled circles (friend lists). The Google+ data were crawled in 2012 from users who had manually shared their circles using the "share circle" feature, and the Twitter data from public sources (lists). Node features (profile information) are given as binary vectors; for Facebook, the feature values have been anonymized, so that only the kind of feature (e.g. `birthday`, `education;school;id`) can be identified.
There are several networks:
- `facebook_<ego>`: the 10 Facebook ego networks (undirected), named by the identifier of the ego;
- `facebook_combined`: the union of all Facebook ego networks (undirected, including the egos), with 4,039 users;
- `gplus_<ego>`: the Google+ ego networks (directed), named by the identifier of the ego (the 131 ego networks of the source with at least one edge);
-- `gplus_combined`: the union of all Google+ ego networks (directed), with 107,614 users.
+- `gplus_combined`: the union of all Google+ ego networks (directed), with 107,614 users;
+- `twitter_<ego>`: the 973 Twitter ego networks (directed), named by the identifier of the ego;
+- `twitter_combined`: the union of all Twitter ego networks (directed), with 81,306 users.
-Nodes are users. In Facebook, an undirected edge means that the two users are friends; in Google+, a directed edge $i \\to j$ means that user $i$ follows user $j$. The original data also include Twitter ego networks, which are not included here.
+Nodes are users. In Facebook, an undirected edge means that the two users are friends; in Google+ and Twitter, a directed edge $i \\to j$ means that user $i$ follows user $j$. For Twitter, the features are the hashtags (e.g. `#python`) and user mentions (e.g. `@nytimes`) used by the users. The features of the egos themselves are not included.
The networks have the following properties:
@@ -36,7 +38,8 @@ The networks have the following properties:
- Graph (ego networks): `feat_names`, a dictionary mapping each position of the feature vector to the name of the feature (e.g. `gender:1` or `birthday;anonymized feature 0`)."""
tags = ['Social', 'Online', 'Unweighted', 'Metadata']
url = ['https://snap.stanford.edu/data/egonets-Facebook.html',
- 'https://snap.stanford.edu/data/egonets-Gplus.html']
+ 'https://snap.stanford.edu/data/egonets-Gplus.html',
+ 'https://snap.stanford.edu/data/egonets-Twitter.html']
citation = [('J. McAuley and J. Leskovec. "Learning to Discover Social Circles in Ego Networks." NIPS (2012). arxiv:1210.8182', 'http://arxiv.org/abs/1210.8182')]
icon_hash = '56a85c8e26855e083a2f78b0'
upstream_license = None
@@ -92,7 +95,184 @@ files = [((f'facebook.tar.gz:facebook/{d}.edges', f'facebook.tar.gz:facebook/{d}
117503822947457399073, 117668392750579292609, 117734260411963901771,
117798157258572080176, 117866881767579360121, 118107045405823607895,
118255645714452180374, 118379821279745746467]] + \
- [('gplus_combined.txt.gz', "gplus_combined", "snap")]
+ [('gplus_combined.txt.gz', "gplus_combined", "snap")] + \
+ [((f'twitter.tar.gz:twitter/{d}.edges', f'twitter.tar.gz:twitter/{d}.feat',
+ f'twitter.tar.gz:twitter/{d}.featnames',
+ f'twitter.tar.gz:twitter/{d}.circles'), f'twitter_{d}', "snap") for d in
+ [12831, 78813, 356963, 428333, 612473, 613313, 623623,
+ 629863, 734493, 742143, 745823, 759679, 778446, 779715,
+ 789071, 790205, 809864, 819800, 926981, 1046661, 1239671,
+ 1271901, 1367531, 1422311, 1435461, 1548841, 1608991,
+ 1775731, 2029971, 2097571, 2257971, 2363991, 2576401,
+ 2589521, 2841151, 2890961, 3245291, 3253671, 3338681,
+ 4258591, 4387041, 5471892, 5506012, 5539522, 5747502,
+ 5773532, 5774432, 5868402, 6018292, 6165372, 6253282,
+ 6297852, 6351572, 6408382, 6650612, 7098022, 7144422,
+ 7424642, 7517222, 7668362, 7670202, 7682452, 7861312,
+ 7875912, 7888452, 7890392, 8079892, 8768832, 8914942,
+ 9215692, 9254272, 9298152, 9460682, 9524062, 9855382,
+ 10146102, 10798802, 10985532, 11027262, 11136132, 11348282,
+ 11348722, 11681802, 11784842, 11828432, 11928542, 12069912,
+ 12152402, 12415722, 12570812, 12771872, 13179562, 13212502,
+ 13274152, 13275962, 13317162, 13460312, 13649212, 13747362,
+ 13809612, 13811562, 13837812, 13872872, 14045302, 14058831,
+ 14060856, 14077024, 14120151, 14120253, 14129601, 14134942,
+ 14147754, 14150874, 14191254, 14199378, 14203895, 14256927,
+ 14313005, 14327149, 14332288, 14338082, 14353392, 14365883,
+ 14371740, 14372486, 14372763, 14404235, 14422788, 14426892,
+ 14505838, 14521330, 14528221, 14550962, 14555534, 14618160,
+ 14630490, 14677919, 14711172, 14719129, 14755105, 14791232,
+ 14794851, 14807093, 14827526, 14836915, 14838506, 14840869,
+ 14843763, 14848513, 14849487, 14869783, 14893314, 14917050,
+ 14922225, 14936377, 14957252, 14984096, 15001424, 15012486,
+ 15053535, 15070932, 15099384, 15129912, 15164892, 15208246,
+ 15292446, 15329577, 15331855, 15335809, 15347317, 15419775,
+ 15420650, 15445811, 15473958, 15477120, 15481789, 15507297,
+ 15527013, 15533771, 15589323, 15642031, 15647676, 15665127,
+ 15706128, 15741636, 15797184, 15849055, 15859268, 15864197,
+ 15924858, 15938936, 15944663, 15947217, 15977848, 15989218,
+ 16027078, 16105942, 16183380, 16193542, 16212913, 16234125,
+ 16247469, 16263665, 16279105, 16285517, 16297193, 16305227,
+ 16421962, 16437633, 16465113, 16476088, 16505296, 16591188,
+ 16606585, 16610683, 16613128, 16616109, 16652550, 16674149,
+ 16685316, 16726878, 16734718, 16790036, 16809036, 16824073,
+ 16834201, 16840742, 16869298, 16878507, 16987303, 17022544,
+ 17045060, 17111909, 17135931, 17137927, 17384099, 17396702,
+ 17403755, 17421011, 17503591, 17561785, 17600223, 17602896,
+ 17627996, 17636894, 17658786, 17714569, 17723880, 17767841,
+ 17770689, 17787399, 17797990, 17822419, 17866414, 17874544,
+ 17912917, 17918629, 17922109, 18068719, 18069824, 18119683,
+ 18135029, 18191231, 18201401, 18226205, 18252740, 18270489,
+ 18278524, 18338485, 18374320, 18470775, 18472735, 18481292,
+ 18483115, 18486243, 18486881, 18496986, 18534908, 18558612,
+ 18571832, 18594420, 18630326, 18665800, 18681592, 18687625,
+ 18690700, 18718580, 18731347, 18734310, 18788502, 18836167,
+ 18846990, 18886852, 18895362, 18917716, 18923866, 18951737,
+ 18957524, 18988524, 18996905, 19064433, 19110632, 19136295,
+ 19208450, 19213083, 19225156, 19283723, 19299909, 19380307,
+ 19454519, 19492215, 19563357, 19658936, 19668026, 19725644,
+ 19760380, 19898730, 19933035, 19948202, 19976791, 20060293,
+ 20119746, 20179628, 20319646, 20347014, 20436059, 20446839,
+ 20495756, 20561154, 20689206, 20758393, 20950208, 20999409,
+ 21028234, 21061498, 21077642, 21094279, 21132431, 21222922,
+ 21318259, 21337501, 21339164, 21363077, 21364753, 21391704,
+ 21415375, 21420959, 21437537, 21578499, 21648994, 21731779,
+ 21735280, 21816783, 22106463, 22121627, 22252971, 22745706,
+ 22751884, 22863638, 22879382, 22915745, 22954430, 22958268,
+ 22970486, 22977196, 23334169, 23469247, 23503181, 23742633,
+ 23759573, 23790454, 23889102, 24117694, 24479656, 24541192,
+ 24542441, 24636631, 24815332, 24903302, 24907197, 25179170,
+ 25344777, 25649234, 25650268, 25755158, 26083291, 26103051,
+ 26234692, 26286713, 26335321, 26346966, 26585095, 26604704,
+ 26961048, 27595997, 27853708, 28205087, 28490110, 28628055,
+ 29016037, 29034979, 29357507, 29514951, 30031265, 30096240,
+ 30207757, 30310904, 30313925, 30345417, 30393917, 30824363,
+ 30970675, 31153819, 31179985, 31246395, 31313454, 31317273,
+ 31457243, 31464977, 31477674, 31610343, 31631020, 31949053,
+ 32289713, 32547856, 32574761, 33060624, 33080832, 33097148,
+ 33511585, 33612973, 33617320, 33794839, 33806113, 33868543,
+ 34242979, 34416153, 34805698, 35012277, 35012599, 35166642,
+ 35432497, 35726059, 35926608, 36475508, 36544954, 36618690,
+ 36629388, 36836787, 36953510, 37103386, 37112942, 37170886,
+ 37201612, 37723441, 37792861, 37899473, 37977732, 37992666,
+ 38108292, 38703025, 38761811, 39070445, 39157827, 39322973,
+ 39695043, 40022380, 40564708, 40580577, 40705032, 40777046,
+ 40813518, 40818894, 40981798, 41945050, 42098834, 42522911,
+ 42676302, 42912024, 43003845, 43194901, 43540843, 43858661,
+ 44130462, 44257374, 44394333, 44524106, 44666348, 45145944,
+ 45310286, 45333725, 45690012, 45753733, 45857296, 46160500,
+ 46533358, 47359057, 47673661, 47854857, 48132655, 48436259,
+ 48730516, 49098552, 49253437, 49414491, 49536244, 50145896,
+ 50189671, 51694885, 51775432, 52330027, 52405864, 52442002,
+ 52498113, 52772629, 53235381, 53685618, 54107218, 54168315,
+ 54178513, 54226675, 54331626, 54460963, 54695584, 54791004,
+ 55019615, 55928029, 57828817, 58427526, 58525541, 58641627,
+ 58930815, 59359628, 59588845, 59676554, 61086747, 61158706,
+ 61311054, 61781462, 61890555, 62609430, 62740714, 62759402,
+ 62985251, 63084853, 63207451, 63787760, 64253854, 64441390,
+ 64496469, 64508047, 64619842, 64931560, 65185224, 65357070,
+ 65360846, 66100530, 66136244, 66185823, 66761133, 66804457,
+ 66841215, 67378554, 68179571, 68257605, 68480165, 68732646,
+ 69049114, 69193714, 69548480, 69624952, 70123665, 70160230,
+ 70492333, 70620846, 71091272, 72339761, 73024519, 73025843,
+ 73298877, 73443014, 73707412, 73738774, 74264908, 74651704,
+ 75321229, 75343905, 75370828, 77404713, 77843323, 78138151,
+ 78391198, 78944566, 79797834, 80297299, 80317145, 80479756,
+ 80660928, 80681990, 80688804, 81938351, 82726142, 83048001,
+ 83285096, 83478370, 83883736, 84114921, 84473837, 85432934,
+ 85716069, 86560711, 86664924, 86775971, 86799233, 87004822,
+ 87114066, 87525002, 87771546, 87798068, 88456842, 88639412,
+ 88931752, 89032548, 89826562, 90072587, 90880254, 90998968,
+ 91067832, 92715435, 93006320, 93787797, 93906304, 93998005,
+ 94147192, 94480069, 94915681, 96483973, 96545499, 96843721,
+ 96907622, 98345808, 98633794, 98801140, 99841247, 100318079,
+ 101859065, 101903164, 102765423, 102903198, 103431502,
+ 103865085, 103991905, 104324908, 104615636, 104991493,
+ 105150583, 105398724, 105918870, 107172099, 107418464,
+ 107511013, 107512718, 107516840, 108159877, 108205076,
+ 110536616, 110755733, 111045742, 111374622, 112628165,
+ 113196940, 113509970, 114115460, 114885421, 115221382,
+ 115911638, 116388817, 116798290, 116808228, 117029850,
+ 117671022, 117800618, 117809922, 119897041, 120157205,
+ 120459837, 120679977, 120971873, 121202578, 121258930,
+ 121569946, 121685268, 122216533, 123287376, 123684709,
+ 124296976, 124474025, 125098615, 126067398, 127912925,
+ 128135741, 129093262, 129984134, 130734452, 132519763,
+ 133663120, 134208594, 134943586, 135397331, 135605269,
+ 135704499, 135895585, 136341512, 137046366, 137527381,
+ 141341662, 141488457, 143172151, 143344048, 143661263,
+ 144211337, 144723379, 145573135, 148519842, 150402542,
+ 151175266, 151246522, 151495845, 152062126, 152388029,
+ 152435436, 153245741, 154648125, 154701532, 155661154,
+ 155689319, 155976326, 157488488, 158414847, 158419434,
+ 158874150, 159588456, 159629146, 160237722, 160839015,
+ 163374693, 163491360, 163629705, 163674521, 165580617,
+ 165598423, 165786567, 166214735, 166252256, 167901620,
+ 168224294, 168537920, 169216507, 169780164, 170167167,
+ 170729553, 171202083, 171536167, 174285878, 175529494,
+ 175553601, 176310143, 176589903, 176872879, 176936249,
+ 179065820, 179138862, 180540375, 182609394, 183786731,
+ 184391654, 184594566, 184755890, 185512077, 186354564,
+ 186909156, 187569483, 187744415, 187773078, 188102842,
+ 189111957, 189253902, 189592841, 189875309, 190138306,
+ 190696559, 191896931, 191916463, 191924526, 195475105,
+ 196926575, 197577781, 197602850, 197731654, 197903282,
+ 198327282, 198370650, 198628427, 198941747, 199039532,
+ 199483163, 200214366, 200494218, 202114894, 202195505,
+ 202346485, 203868162, 204145356, 204646586, 206923844,
+ 207594668, 207936757, 211547273, 211933541, 212642904,
+ 212718048, 215328630, 215824411, 216843160, 217796457,
+ 219365298, 222090651, 224581852, 225302763, 227650565,
+ 227785045, 228270980, 229425177, 229741646, 229969377,
+ 230601773, 230880104, 232006900, 232706326, 233598791,
+ 234169190, 235219400, 237019614, 237049769, 237845487,
+ 238264600, 239141315, 239434259, 240740059, 241635675,
+ 242013901, 242024994, 242073660, 242479442, 243267948,
+ 245639401, 248224845, 248523038, 248883350, 248916246,
+ 249829509, 249831237, 250340951, 250447400, 250900294,
+ 252415267, 253360762, 253751053, 253863144, 254883790,
+ 255790981, 256497288, 258145892, 258447233, 258955239,
+ 259288589, 259365099, 259884200, 261973875, 262310943,
+ 263224927, 265077741, 266464616, 267383914, 268425888,
+ 269485905, 269559495, 275686563, 276128869, 276843589,
+ 278181157, 278311152, 279854450, 280329780, 283732062,
+ 285287229, 287519521, 289738351, 290092792, 291403100,
+ 292560337, 296218728, 297985585, 298038575, 300842571,
+ 301297627, 303886358, 306445007, 307458983, 307478701,
+ 308220010, 309096216, 311227912, 312284236, 312805417,
+ 313359626, 314038032, 314316607, 315418321, 317313520,
+ 318760490, 320527944, 321620987, 321652589, 324201646,
+ 324544865, 326259198, 333021748, 333881828, 333966373,
+ 336463060, 338017544, 344966590, 345569115, 348851602,
+ 351092905, 353767514, 355823615, 356897757, 358845982,
+ 359791673, 360025190, 360210947, 364664695, 368018677,
+ 372765570, 374007416, 377662213, 378494343, 381688396,
+ 382110320, 384685422, 384761809, 396721965, 397688944,
+ 398994309, 400867704, 402970625, 407769660, 414334713,
+ 423567032, 430313102, 434433610, 437300342, 441252694,
+ 477094958, 484991854, 493138720, 494538543, 521489919,
+ 528575851, 532617990, 549089429]] + \
+ [('twitter_combined.txt.gz', "twitter_combined", "snap")]
def fetch_upstream(force=False):
return fetch_upstream_files(__name__.split(".")[-1], upstream_prefix, files,
@@ -113,9 +293,9 @@ def parse(alts=None):
fs = [stack.enter_context(open_upstream_file(name, fn, "r" if i > 0 else "rb"))
for i, fn in enumerate(fnames)]
gplus = "gplus" in alt
- # Google+ connections are directed (following relations), and
- # Facebook friendships undirected
- directed = gplus
+ # Google+ and Twitter connections are directed (following
+ # relations), and Facebook friendships undirected
+ directed = gplus or "twitter" in alt
key = str if gplus else int
if len(fs) > 1:
g = parse_graph([fs[0]],
@@ -148,6 +328,10 @@ def parse(alts=None):
g = parse_graph([fs[0]], (fmt, dict(hashed=True,
hash_type="string")),
directed=directed)
+ elif "twitter" in alt:
+ g = parse_graph([fs[0]], (fmt, dict(hashed=True,
+ hash_type="int")),
+ directed=directed)
else:
g = parse_graph([fs[0]], fmt, directed=directed)
remove_parallel_edges(g)
[entries] Fix parse bugs and improve descriptions and metadata 6bb6851
- parse fixes from the review of the descriptions, e.g. us_patents (directed), celegans_2019 (synapse direction), ecoli_transcription and yeast_transcription (regulator to target), bitcoin (direction, phantom node), ego_social (Google+ features and circles), scotus_majority, arxiv_authors and social_location (as in SNAP), caida_as, dnc, dom, mist, reuters and bibsonomy (names on the right nodes), uci_zoo - every description now states explicitly what the nodes and edges represent; corrected titles, years, tags, citations and licences - the "Hypergraph" tag is removed; very large entries are marked `huge = True` (see --skip-huge) - ICON ids of partial duplicates added (hiv_transmission, congress_bills, openflights, dutch_school)
diff --git a/entries/ego_social/__init__.py b/entries/ego_social/__init__.py
index d2585f6..c68c8b8 100644
--- a/entries/ego_social/__init__.py
+++ b/entries/ego_social/__init__.py
@@ -19,13 +19,27 @@
from .. import *
title = "Ego networks in social media (2012)"
-description = """Ego networks associated with a set of accounts of three social media platforms (Facebook, Google+, and Twitter). Datasets include node features (profile metadata), circles, and ego networks, and were crawled from public sources in 2012[^icon]
-[^icon]: Description obtained from the [ICON](https://icon.colorado.edu) project."""
+description = """Ego networks of users of Facebook and Google+, collected by J. McAuley and J. Leskovec to study how users organize their friends into social circles. An ego network consists of the friends of a user (the ego) and the connections among them, where the ego is not included as a node. The Facebook data were collected from survey participants through a Facebook app, and include the users' manually labeled circles (friend lists). The Google+ data were crawled in 2012 from users who had manually shared their circles using the "share circle" feature. Node features (profile information) are given as binary vectors; for Facebook, the feature values have been anonymized, so that only the kind of feature (e.g. `birthday`, `education;school;id`) can be identified.
+
+There are several networks:
+
+- `facebook_<ego>`: the 10 Facebook ego networks (undirected), named by the identifier of the ego;
+- `facebook_combined`: the union of all Facebook ego networks (undirected, including the egos), with 4,039 users;
+- `gplus_<ego>`: the Google+ ego networks (directed), named by the identifier of the ego (the 131 ego networks of the source with at least one edge);
+- `gplus_combined`: the union of all Google+ ego networks (directed), with 107,614 users.
+
+Nodes are users. In Facebook, an undirected edge means that the two users are friends; in Google+, a directed edge $i \\to j$ means that user $i$ follows user $j$. The original data also include Twitter ego networks, which are not included here.
+
+The networks have the following properties:
+
+- Nodes (ego networks): `name`, the identifier of the user; `feat`, the binary feature vector of the user; `circles`, the list of circles of the ego to which the user belongs, each identified by its index (starting from 0) in the circles file of the source data.
+- Graph (ego networks): `feat_names`, a dictionary mapping each position of the feature vector to the name of the feature (e.g. `gender:1` or `birthday;anonymized feature 0`)."""
tags = ['Social', 'Online', 'Unweighted', 'Metadata']
-url = 'http://snap.stanford.edu/data/egonets-Facebook.html'
+url = ['https://snap.stanford.edu/data/egonets-Facebook.html',
+ 'https://snap.stanford.edu/data/egonets-Gplus.html']
citation = [('J. McAuley and J. Leskovec. "Learning to Discover Social Circles in Ego Networks." NIPS (2012). arxiv:1210.8182', 'http://arxiv.org/abs/1210.8182')]
icon_hash = '56a85c8e26855e083a2f78b0'
-ustream_license = None
+upstream_license = None
upstream_prefix = 'https://snap.stanford.edu/data'
files = [((f'facebook.tar.gz:facebook/{d}.edges', f'facebook.tar.gz:facebook/{d}.feat',
f'facebook.tar.gz:facebook/{d}.featnames', f'facebook.tar.gz:facebook/{d}.circles'), f'facebook_{d}', "snap")
@@ -98,17 +112,22 @@ def parse(alts=None):
with ExitStack() as stack:
fs = [stack.enter_context(open_upstream_file(name, fn, "r" if i > 0 else "rb"))
for i, fn in enumerate(fnames)]
+ gplus = "gplus" in alt
+ # Google+ connections are directed (following relations), and
+ # Facebook friendships undirected
+ directed = gplus
+ key = str if gplus else int
if len(fs) > 1:
g = parse_graph([fs[0]],
(fmt, dict(hashed=True, hash_type="string"
- if "gplus" in alt else "int")),
- directed=False)
+ if gplus else "int")),
+ directed=directed)
vs = {g.vp.name[v]: v for v in g.vertices()}
g.vp.feat = g.new_vp("vector<bool>")
for line in fs[1]:
vals = line.split()
try:
- v = vs[int(vals[0])]
+ v = vs[key(vals[0])]
except KeyError:
continue
g.vp.feat[v] = [int(x) for x in vals[1:]]
@@ -121,15 +140,15 @@ def parse(alts=None):
vals = line.split()
for x in vals[1:]:
try:
- g.vp.circles[vs[int(x)]].append(i)
+ g.vp.circles[vs[key(x)]].append(i)
except KeyError:
continue
else:
- if "gplus" in alt:
+ if gplus:
g = parse_graph([fs[0]], (fmt, dict(hashed=True,
hash_type="string")),
- directed=False)
+ directed=directed)
else:
- g = parse_graph([fs[0]], fmt, directed=False)
+ g = parse_graph([fs[0]], fmt, directed=directed)
remove_parallel_edges(g)
yield alt, g
Update copyright information 73a4f0d
diff --git a/entries/ego_social/__init__.py b/entries/ego_social/__init__.py
index 73674ce..d2585f6 100644
--- a/entries/ego_social/__init__.py
+++ b/entries/ego_social/__init__.py
@@ -1,7 +1,7 @@
#! /usr/bin/env python
# -*- coding: utf-8 -*-
#
-# Copyright (C) 2020-2024 Tiago de Paula Peixoto <tiago@skewed.de>
+# Copyright (C) 2020-2026 Tiago de Paula Peixoto <tiago@skewed.de>
#
# This program is free software: you can redistribute it and/or modify it under
# the terms of the GNU Affero General Public License as published by the Free
Update copyright information 3d288ea
diff --git a/entries/ego_social/__init__.py b/entries/ego_social/__init__.py
index 8e577c6..73674ce 100644
--- a/entries/ego_social/__init__.py
+++ b/entries/ego_social/__init__.py
@@ -1,7 +1,7 @@
#! /usr/bin/env python
# -*- coding: utf-8 -*-
#
-# Copyright (C) 2020-2023 Tiago de Paula Peixoto <tiago@skewed.de>
+# Copyright (C) 2020-2024 Tiago de Paula Peixoto <tiago@skewed.de>
#
# This program is free software: you can redistribute it and/or modify it under
# the terms of the GNU Affero General Public License as published by the Free
Update copyright information 8d005ae
diff --git a/entries/ego_social/__init__.py b/entries/ego_social/__init__.py
index 7b787db..8e577c6 100644
--- a/entries/ego_social/__init__.py
+++ b/entries/ego_social/__init__.py
@@ -1,7 +1,7 @@
#! /usr/bin/env python
# -*- coding: utf-8 -*-
#
-# Copyright (C) 2021 Tiago de Paula Peixoto <tiago@skewed.de>
+# Copyright (C) 2020-2023 Tiago de Paula Peixoto <tiago@skewed.de>
#
# This program is free software: you can redistribute it and/or modify it under
# the terms of the GNU Affero General Public License as published by the Free
Update copyright info db2efcc
diff --git a/entries/ego_social/__init__.py b/entries/ego_social/__init__.py
index 92710c2..7b787db 100644
--- a/entries/ego_social/__init__.py
+++ b/entries/ego_social/__init__.py
@@ -1,7 +1,7 @@
#! /usr/bin/env python
# -*- coding: utf-8 -*-
#
-# Copyright (C) 2020 Tiago de Paula Peixoto <tiago@skewed.de>
+# Copyright (C) 2021 Tiago de Paula Peixoto <tiago@skewed.de>
#
# This program is free software: you can redistribute it and/or modify it under
# the terms of the GNU Affero General Public License as published by the Free
Change license from GPLv3 to AGPLv3 d754be5
diff --git a/entries/ego_social/__init__.py b/entries/ego_social/__init__.py
index 8e80e76..92710c2 100644
--- a/entries/ego_social/__init__.py
+++ b/entries/ego_social/__init__.py
@@ -3,18 +3,18 @@
#
# Copyright (C) 2020 Tiago de Paula Peixoto <tiago@skewed.de>
#
-# This program is free software: you can redistribute it and/or modify
-# it under the terms of the GNU General Public License as published by
-# the Free Software Foundation, either version 3 of the License, or
-# (at your option) any later version.
+# This program is free software: you can redistribute it and/or modify it under
+# the terms of the GNU Affero General Public License as published by the Free
+# Software Foundation, either version 3 of the License, or (at your option) any
+# later version.
#
-# This program is distributed in the hope that it will be useful,
-# but WITHOUT ANY WARRANTY; without even the implied warranty of
-# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
-# GNU General Public License for more details.
+# This program is distributed in the hope that it will be useful, but WITHOUT
+# ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS
+# FOR A PARTICULAR PURPOSE. See the GNU Affero General Public License for more
+# details.
#
-# You should have received a copy of the GNU General Public License
-# along with this program. If not, see <http://www.gnu.org/licenses/>.
+# You should have received a copy of the GNU Affero General Public License along
+# with this program. If not, see <http://www.gnu.org/licenses/>.
from .. import *
Add explicit attribution to descriptions obtained from ICON 1645314
diff --git a/entries/ego_social/__init__.py b/entries/ego_social/__init__.py
index e7740d8..8e80e76 100644
--- a/entries/ego_social/__init__.py
+++ b/entries/ego_social/__init__.py
@@ -19,7 +19,8 @@
from .. import *
title = "Ego networks in social media (2012)"
-description = "Ego networks associated with a set of accounts of three social media platforms (Facebook, Google+, and Twitter). Datasets include node features (profile metadata), circles, and ego networks, and were crawled from public sources in 2012"
+description = """Ego networks associated with a set of accounts of three social media platforms (Facebook, Google+, and Twitter). Datasets include node features (profile metadata), circles, and ego networks, and were crawled from public sources in 2012[^icon]
+[^icon]: Description obtained from the [ICON](https://icon.colorado.edu) project."""
tags = ['Social', 'Online', 'Unweighted', 'Metadata']
url = 'http://snap.stanford.edu/data/egonets-Facebook.html'
citation = [('J. McAuley and J. Leskovec. "Learning to Discover Social Circles in Ego Networks." NIPS (2012). arxiv:1210.8182', 'http://arxiv.org/abs/1210.8182')]
Initial commit cc85872
diff --git a/entries/ego_social/__init__.py b/entries/ego_social/__init__.py
new file mode 100644
index 0000000..e7740d8
--- /dev/null
+++ b/entries/ego_social/__init__.py
@@ -0,0 +1,134 @@
+#! /usr/bin/env python
+# -*- coding: utf-8 -*-
+#
+# Copyright (C) 2020 Tiago de Paula Peixoto <tiago@skewed.de>
+#
+# This program is free software: you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation, either version 3 of the License, or
+# (at your option) any later version.
+#
+# This program is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program. If not, see <http://www.gnu.org/licenses/>.
+
+from .. import *
+
+title = "Ego networks in social media (2012)"
+description = "Ego networks associated with a set of accounts of three social media platforms (Facebook, Google+, and Twitter). Datasets include node features (profile metadata), circles, and ego networks, and were crawled from public sources in 2012"
+tags = ['Social', 'Online', 'Unweighted', 'Metadata']
+url = 'http://snap.stanford.edu/data/egonets-Facebook.html'
+citation = [('J. McAuley and J. Leskovec. "Learning to Discover Social Circles in Ego Networks." NIPS (2012). arxiv:1210.8182', 'http://arxiv.org/abs/1210.8182')]
+icon_hash = '56a85c8e26855e083a2f78b0'
+ustream_license = None
+upstream_prefix = 'https://snap.stanford.edu/data'
+files = [((f'facebook.tar.gz:facebook/{d}.edges', f'facebook.tar.gz:facebook/{d}.feat',
+ f'facebook.tar.gz:facebook/{d}.featnames', f'facebook.tar.gz:facebook/{d}.circles'), f'facebook_{d}', "snap")
+ for d in [0,107,348,414,686,698,1684,1912,3437,3980]] + \
+ [('facebook_combined.txt.gz', "facebook_combined", "snap")] + \
+ [((f'gplus.tar.gz:gplus/{d}.edges', f'gplus.tar.gz:gplus/{d}.feat',
+ f'gplus.tar.gz:gplus/{d}.featnames',
+ f'gplus.tar.gz:gplus/{d}.circles'), f'gplus_{d}', "snap") for d in
+ [100129275726588145876, 100329698645326486178, 100466178325794757407,
+ 100500197140377336562, 100518419853963396365, 100521671383026672718,
+ 100535338638690515335, 100637660947564674695, 100668989009254813743,
+ 100715738096376666180, 100720409235366385249, 100962871525684315897,
+ 101130571432010257170, 101133961721621664586, 101185748996927059931,
+ 101263615503715477581, 101373961279443806744, 101499880233887429402,
+ 101541879642294398860, 101560853443212199687, 101626577406833098387,
+ 101848191156408080085, 101997124338642780860, 102170431816592344972,
+ 102340116189726655233, 102615863344410467759, 102778563580121606331,
+ 103236949470535942612, 103241736833663734962, 103251633033550231172,
+ 103338524411980406972, 103503116383846951534, 103537112468125883734,
+ 103752943025677384806, 103892332449873403244, 104076158580173410325,
+ 104105354262797387583, 104226133029319075907, 104290609881668164623,
+ 104607825525972194062, 104672614700283598130, 104905626100400792399,
+ 104917160754181459072, 104987932455782713675, 105565257978663183206,
+ 105646458226420473639, 106186407539128840569, 106228758905254036967,
+ 106328207304735502636, 106382433884876652170, 106417861423111072106,
+ 106724181552911298818, 106837574755355833243, 107013688749125521109,
+ 107040353898400532534, 107203023379915799071, 107223200089245371832,
+ 107296660002634487593, 107362628080904735459, 107459220492917008623,
+ 107489144252174167638, 107965826228461029730, 108156134340151350951,
+ 108404515213153345305, 108541235642523883716, 108883879052307976051,
+ 109130886479781915270, 109213135085178239952, 109327480479767108490,
+ 109342148209917802565, 109596373340495798827, 109602109099036550366,
+ 110232479818136355682, 110241952466097562819, 110538600381916983600,
+ 110581012109008817546, 110614416163543421878, 110701307803962595019,
+ 110739220927723360152, 110809308822849680310, 110971010308065250763,
+ 111048918866742956374, 111058843129764709244, 111091089527727420853,
+ 111213696402662884531, 112317819390625199896, 112463391491520264813,
+ 112573107772208475213, 112724573277710080670, 112737356589974073749,
+ 112787435697866537461, 113112256846010263985, 113122049849685469495,
+ 113171096418029011322, 113356364521839061717, 113455290791279442483,
+ 113597493946570654755, 113718775944980638561, 113799277735885972934,
+ 113881433443048137993, 114054672576929802335, 114104634069486127920,
+ 114122960748905067938, 114124942936679476879, 114147483140782280818,
+ 114336431216099933033, 115121555137256496805, 115273860520983542999,
+ 115360471097759949621, 115455024457484679647, 115516333681138986628,
+ 115573545440464933254, 115576988435396060952, 115625564993990145546,
+ 116059998563577101552, 116247667398036716276, 116315897040732668413,
+ 116450966137824114154, 116807883656585676940, 116825083494890429556,
+ 116899029375914044550, 116931379084245069738, 117412175333096244275,
+ 117503822947457399073, 117668392750579292609, 117734260411963901771,
+ 117798157258572080176, 117866881767579360121, 118107045405823607895,
+ 118255645714452180374, 118379821279745746467]] + \
+ [('gplus_combined.txt.gz', "gplus_combined", "snap")]
+
+def fetch_upstream(force=False):
+ return fetch_upstream_files(__name__.split(".")[-1], upstream_prefix, files,
+ force)
+
+@cache_network()
+@coerce_props()
+@annotate()
+def parse(alts=None):
+ global files
+ name = __name__.split(".")[-1]
+ for fnames, alt, fmt in files:
+ if alts is not None and alt not in alts:
+ continue
+ if isinstance(fnames, str):
+ fnames = [fnames]
+ with ExitStack() as stack:
+ fs = [stack.enter_context(open_upstream_file(name, fn, "r" if i > 0 else "rb"))
+ for i, fn in enumerate(fnames)]
+ if len(fs) > 1:
+ g = parse_graph([fs[0]],
+ (fmt, dict(hashed=True, hash_type="string"
+ if "gplus" in alt else "int")),
+ directed=False)
+ vs = {g.vp.name[v]: v for v in g.vertices()}
+ g.vp.feat = g.new_vp("vector<bool>")
+ for line in fs[1]:
+ vals = line.split()
+ try:
+ v = vs[int(vals[0])]
+ except KeyError:
+ continue
+ g.vp.feat[v] = [int(x) for x in vals[1:]]
+ g.gp.feat_names = g.new_gp("object", val={})
+ for line in fs[2]:
+ vals = line.split()
+ g.gp.feat_names[int(vals[0])] = " ".join(vals[1:])
+ g.vp.circles = g.new_vp("vector<int>")
+ for i, line in enumerate(fs[3]):
+ vals = line.split()
+ for x in vals[1:]:
+ try:
+ g.vp.circles[vs[int(x)]].append(i)
+ except KeyError:
+ continue
+ else:
+ if "gplus" in alt:
+ g = parse_graph([fs[0]], (fmt, dict(hashed=True,
+ hash_type="string")),
+ directed=False)
+ else:
+ g = parse_graph([fs[0]], fmt, directed=False)
+ remove_parallel_edges(g)
+ yield alt, g