History of scotus_majority
The changes to the source code of this entry in the repository, newest first, each with the differences it made to the entry's files. They are also listed on GitLab.
[entries] Add the date when each entry was added, and remove icon_hash beff7c9
The dates are those of the commits that first added the entries' files (2020-08-11 for the entries of the initial commit); renamed entries keep the date of their first name. Changed: none
diff --git a/entries/scotus_majority/__init__.py b/entries/scotus_majority/__init__.py
index b7500c2..1edec7a 100644
--- a/entries/scotus_majority/__init__.py
+++ b/entries/scotus_majority/__init__.py
@@ -53,8 +53,7 @@ url = ['https://doi.org/10.7910/DVN/XMBQL6',
'https://web.archive.org/web/20210412235953/http://fowler.ucsd.edu/judicial.htm']
citation = [('J. H. Fowler and S. Jeon, "The Authority of Supreme Court Precedent." Social Networks 30(1), 16-30 (2008)', 'https://doi.org/10.1016/j.socnet.2007.05.001'),
('J. H. Fowler et al., "Network Analysis and the Law: Measuring the Legal Importance of Supreme Court Precedents." Political Analysis 15(3), 324-346 (2007)', 'https://doi.org/10.1093/pan/mpm011')]
-icon_hash = ['57114fb76afce8e9253875c7',
- '571152dc6afce8e9253875c9']
+date_added = '2020-09-26'
upstream_license = None
upstream_prefix = 'http://jhfowler.ucsd.edu/data'
files = [(('judicial.zip:allcites.txt', 'judicial.zip:judicial.csv'), "2008", 'loadtxt'),
[entries] Prefix the properties in the descriptions with (Node), (Edge) or (Graph) bc3dbbd
The lists of properties at the end of the descriptions marked edge properties with "Edge" but left node properties unmarked, or grouped them in "Nodes: `a`, ...; `b`, ..." items, so the kind of a property was often unclear. Every item now starts with (Node), (Edge) or (Graph), followed by the property names, a colon and the explanation, one item per property or group of properties; qualifications (kinds of nodes, networks) follow the names in parentheses. Properties that were only named got a short explanation, and a few items that named the wrong kind of property were corrected.
diff --git a/entries/scotus_majority/__init__.py b/entries/scotus_majority/__init__.py
index 7f5ec6f..b7500c2 100644
--- a/entries/scotus_majority/__init__.py
+++ b/entries/scotus_majority/__init__.py
@@ -28,8 +28,26 @@ description = """Networks of citations among majority opinions of the Supreme Co
The networks have the following properties:
-- `2008`: `name`, the numerical case identifier of the data set; `usid`, the U.S. Reports citation (e.g. `3US320`); `parties`, the names of the parties to the case; `year`, the year of the case; `overruled`, the identifier of the case that overruled it (0 if none); `overruling`, the list of identifiers of the cases it overruled; `oxford` and `liihc`, whether the case appears in the Oxford list of salient cases and in the Legal Information Institute's list of important cases, respectively.
-- `2007`: `lexid`, the LexisNexis identifier; `usid`, the U.S. Reports citation; `name`, the parties to the case; `citedyr_num`, the year of the case; `citingyr_num`, the year in which the variables were measured (2005); `age`, the age of the case in years; `auth_num`, the authority score (the hub/authority centrality of Kleinberg) of the case; `insc_num`, `apin_num` and `stin_num`, the number of citations the case received from the Supreme Court, from federal appeals courts and from state courts, respectively, and `insc_num_lag`, `apin_num_lag`, `stin_num_lag`, `outsc_num_lag` and `sc_cumul_cites_lag`, lagged versions of these counts and of the outward and cumulative Supreme Court citations; `oxford_num`, `cq_num` and `nyt_num`, whether the case appears in the Oxford Guide to Supreme Court decisions, in the Congressional Quarterly guide to the Supreme Court, or on the front page of the New York Times, respectively; `amiciz_num`, a standardized count of amicus curiae briefs filed in the case; `size_num`, the number of cases in the network at the time of measurement. These are the variables of the replication data, used as validation measures of legal importance in the paper; their precise definitions are given there."""
+- (Node) `name` (`2008`): the numerical case identifier of the data set.
+- (Node) `usid` (`2008`): the U.S. Reports citation (e.g. `3US320`).
+- (Node) `parties` (`2008`): the names of the parties to the case.
+- (Node) `year` (`2008`): the year of the case.
+- (Node) `overruled` (`2008`): the identifier of the case that overruled it (0 if none).
+- (Node) `overruling` (`2008`): the list of identifiers of the cases it overruled.
+- (Node) `oxford`, `liihc` (`2008`): whether the case appears in the Oxford list of salient cases and in the Legal Information Institute's list of important cases, respectively.
+- (Node) `lexid` (`2007`): the LexisNexis identifier.
+- (Node) `usid` (`2007`): the U.S. Reports citation.
+- (Node) `name` (`2007`): the parties to the case.
+- (Node) `citedyr_num` (`2007`): the year of the case.
+- (Node) `citingyr_num` (`2007`): the year in which the variables were measured (2005).
+- (Node) `age` (`2007`): the age of the case in years.
+- (Node) `auth_num` (`2007`): the authority score (the hub/authority centrality of Kleinberg) of the case.
+- (Node) `insc_num`, `apin_num`, `stin_num` (`2007`): the number of citations the case received from the Supreme Court, from federal appeals courts and from state courts, respectively.
+- (Node) `insc_num_lag`, `apin_num_lag`, `stin_num_lag`, `outsc_num_lag`, `sc_cumul_cites_lag` (`2007`): lagged versions of these counts and of the outward and cumulative Supreme Court citations.
+- (Node) `oxford_num`, `cq_num`, `nyt_num` (`2007`): whether the case appears in the Oxford Guide to Supreme Court decisions, in the Congressional Quarterly guide to the Supreme Court, or on the front page of the New York Times, respectively.
+- (Node) `amiciz_num` (`2007`): a standardized count of amicus curiae briefs filed in the case.
+- (Node) `size_num` (`2007`): the number of cases in the network at the time of measurement.
+- (Node) The properties of `2007` are the variables of the replication data, used as validation measures of legal importance in the paper; their precise definitions are given there."""
tags = ['Informational', 'Legal', 'Unweighted', 'Metadata', 'Temporal']
url = ['https://doi.org/10.7910/DVN/XMBQL6',
'https://web.archive.org/web/20210412235953/http://fowler.ucsd.edu/judicial.htm']
[entries] Remove unneeded code from the entries 2c69f19
Unneeded "global files" statements, unused imports and variables, f-strings without placeholders, duplicate keys in foodweb_little_rock (keeping the order and the values used), and the second definition of get_lines() in twitter_higgs. Nothing changes in the networks or descriptions. Changed: none
diff --git a/entries/scotus_majority/__init__.py b/entries/scotus_majority/__init__.py
index 861a6b1..7f5ec6f 100644
--- a/entries/scotus_majority/__init__.py
+++ b/entries/scotus_majority/__init__.py
@@ -59,7 +59,6 @@ def fetch_upstream(force=False):
@coerce_props()
@annotate()
def parse(alts=None):
- global files
name = __name__.split(".")[-1]
for fnames, alt, fmt in files:
if alts is not None and alt not in alts:
[entries] Move unavailable upstream sources to verified alternatives 2137af6
The upstream sources of these entries are gone, moved, or refuse automated downloads; each now downloads the same data (byte-identical to the cached files, or for board_directors, identical apart from line endings) from: - add_health: the Wayback Machine (Moreno's site, as its sibling entries) - board_directors: T. Opsahl's site (opsahl.co.uk) - copenhagen, cow_signed_relations, fullerene_structures, german_power_grid: figshare's API (its downloader refuses the server) - drosophila_flybi: the same address, without a doubled slash - dutch_criticism: V. Batagelj's repository of Pajek data on GitHub - fly_larva: the copy of the supplementary files in Europe PMC - foursquare: the authors' Google Drive file - game_thrones, microsoft_concept, un_migrations: pinned Wayback Machine snapshots - internet_top_pop: the Topology Zoo repository on GitHub - scotus_majority: Harvard Dataverse and Wayback Machine snapshots
diff --git a/entries/scotus_majority/__init__.py b/entries/scotus_majority/__init__.py
index ba3f85e..861a6b1 100644
--- a/entries/scotus_majority/__init__.py
+++ b/entries/scotus_majority/__init__.py
@@ -31,7 +31,8 @@ The networks have the following properties:
- `2008`: `name`, the numerical case identifier of the data set; `usid`, the U.S. Reports citation (e.g. `3US320`); `parties`, the names of the parties to the case; `year`, the year of the case; `overruled`, the identifier of the case that overruled it (0 if none); `overruling`, the list of identifiers of the cases it overruled; `oxford` and `liihc`, whether the case appears in the Oxford list of salient cases and in the Legal Information Institute's list of important cases, respectively.
- `2007`: `lexid`, the LexisNexis identifier; `usid`, the U.S. Reports citation; `name`, the parties to the case; `citedyr_num`, the year of the case; `citingyr_num`, the year in which the variables were measured (2005); `age`, the age of the case in years; `auth_num`, the authority score (the hub/authority centrality of Kleinberg) of the case; `insc_num`, `apin_num` and `stin_num`, the number of citations the case received from the Supreme Court, from federal appeals courts and from state courts, respectively, and `insc_num_lag`, `apin_num_lag`, `stin_num_lag`, `outsc_num_lag` and `sc_cumul_cites_lag`, lagged versions of these counts and of the outward and cumulative Supreme Court citations; `oxford_num`, `cq_num` and `nyt_num`, whether the case appears in the Oxford Guide to Supreme Court decisions, in the Congressional Quarterly guide to the Supreme Court, or on the front page of the New York Times, respectively; `amiciz_num`, a standardized count of amicus curiae briefs filed in the case; `size_num`, the number of cases in the network at the time of measurement. These are the variables of the replication data, used as validation measures of legal importance in the paper; their precise definitions are given there."""
tags = ['Informational', 'Legal', 'Unweighted', 'Metadata', 'Temporal']
-url = 'http://fowler.ucsd.edu/judicial.htm'
+url = ['https://doi.org/10.7910/DVN/XMBQL6',
+ 'https://web.archive.org/web/20210412235953/http://fowler.ucsd.edu/judicial.htm']
citation = [('J. H. Fowler and S. Jeon, "The Authority of Supreme Court Precedent." Social Networks 30(1), 16-30 (2008)', 'https://doi.org/10.1016/j.socnet.2007.05.001'),
('J. H. Fowler et al., "Network Analysis and the Law: Measuring the Legal Importance of Supreme Court Precedents." Political Analysis 15(3), 324-346 (2007)', 'https://doi.org/10.1093/pan/mpm011')]
icon_hash = ['57114fb76afce8e9253875c7',
@@ -42,9 +43,17 @@ files = [(('judicial.zip:allcites.txt', 'judicial.zip:judicial.csv'), "2008", 'l
(('Pol_Analysis_ussc_cites.csv.zip:Pol_Analysis_ussc_cites.csv',
'Pol_Analysis_replication.zip:Pol_Analysis_replication.dta'), "2007", 'csv')]
+# J. H. Fowler's site is no longer online: the data of the 2008 paper are
+# fetched from its replication data set in the Harvard Dataverse, and the
+# replication data of the 2007 paper from pinned Internet Archive snapshots
+archived_urls = {
+ 'judicial.zip': 'https://dataverse.harvard.edu/api/access/datafile/614752',
+ 'Pol_Analysis_ussc_cites.csv.zip': 'https://web.archive.org/web/20160825231344id_/http://jhfowler.ucsd.edu/data/Pol_Analysis_ussc_cites.csv.zip',
+ 'Pol_Analysis_replication.zip': 'https://web.archive.org/web/20160825231017id_/http://jhfowler.ucsd.edu/data/Pol_Analysis_replication.zip'}
+
def fetch_upstream(force=False):
- return fetch_upstream_files(__name__.split(".")[-1], upstream_prefix, files,
- force)
+ return fetch_archived_files(__name__.split(".")[-1], archived_urls, force,
+ tries=4)
@cache_network()
@coerce_props()
[entries] Fix parse bugs and improve descriptions and metadata 6bb6851
- parse fixes from the review of the descriptions, e.g. us_patents (directed), celegans_2019 (synapse direction), ecoli_transcription and yeast_transcription (regulator to target), bitcoin (direction, phantom node), ego_social (Google+ features and circles), scotus_majority, arxiv_authors and social_location (as in SNAP), caida_as, dnc, dom, mist, reuters and bibsonomy (names on the right nodes), uci_zoo - every description now states explicitly what the nodes and edges represent; corrected titles, years, tags, citations and licences - the "Hypergraph" tag is removed; very large entries are marked `huge = True` (see --skip-huge) - ICON ids of partial duplicates added (hiv_transmission, congress_bills, openflights, dutch_school)
diff --git a/entries/scotus_majority/__init__.py b/entries/scotus_majority/__init__.py
index d4a8806..ba3f85e 100644
--- a/entries/scotus_majority/__init__.py
+++ b/entries/scotus_majority/__init__.py
@@ -21,14 +21,22 @@ from .. import *
import pandas
title = "SCOTUS majority opinions"
-description = """Network of legal citations among majority opinions written by the Supreme Court of the United States (SCOTUS), from 1754-2002 (2008 version) and 1792-2006 (2007 version). In addition to the citation network, node metadata is included giving some description of each opinion.[^icon]
-[^icon]: Description obtained from the [ICON](https://icon.colorado.edu) project."""
+description = """Networks of citations among majority opinions of the Supreme Court of the United States (SCOTUS), compiled by J. H. Fowler and S. Jeon. Nodes are cases (majority opinions) and a directed edge indicates that the opinion of one case cites another case. The two versions come from two data releases:
+
+- `2008`: data accompanying Fowler and Jeon (Social Networks, 2008), covering the cases in the U.S. Reports from 1754 to 2002. The citations were extracted from the text of the opinions. Edges point from the citing case to the cited case. Only cases that are part of at least one citation are included.
+- `2007`: replication data of Fowler et al. (Political Analysis, 2007), with cases decided from 1791 to 2005 identified by their LexisNexis identifiers. Edges point from the citing case to the cited case. For about 9,600 nodes no metadata is available, and their properties are empty (text) or NaN (numerical).
+
+The networks have the following properties:
+
+- `2008`: `name`, the numerical case identifier of the data set; `usid`, the U.S. Reports citation (e.g. `3US320`); `parties`, the names of the parties to the case; `year`, the year of the case; `overruled`, the identifier of the case that overruled it (0 if none); `overruling`, the list of identifiers of the cases it overruled; `oxford` and `liihc`, whether the case appears in the Oxford list of salient cases and in the Legal Information Institute's list of important cases, respectively.
+- `2007`: `lexid`, the LexisNexis identifier; `usid`, the U.S. Reports citation; `name`, the parties to the case; `citedyr_num`, the year of the case; `citingyr_num`, the year in which the variables were measured (2005); `age`, the age of the case in years; `auth_num`, the authority score (the hub/authority centrality of Kleinberg) of the case; `insc_num`, `apin_num` and `stin_num`, the number of citations the case received from the Supreme Court, from federal appeals courts and from state courts, respectively, and `insc_num_lag`, `apin_num_lag`, `stin_num_lag`, `outsc_num_lag` and `sc_cumul_cites_lag`, lagged versions of these counts and of the outward and cumulative Supreme Court citations; `oxford_num`, `cq_num` and `nyt_num`, whether the case appears in the Oxford Guide to Supreme Court decisions, in the Congressional Quarterly guide to the Supreme Court, or on the front page of the New York Times, respectively; `amiciz_num`, a standardized count of amicus curiae briefs filed in the case; `size_num`, the number of cases in the network at the time of measurement. These are the variables of the replication data, used as validation measures of legal importance in the paper; their precise definitions are given there."""
tags = ['Informational', 'Legal', 'Unweighted', 'Metadata', 'Temporal']
url = 'http://fowler.ucsd.edu/judicial.htm'
citation = [('J. H. Fowler and S. Jeon, "The Authority of Supreme Court Precedent." Social Networks 30(1), 16-30 (2008)', 'https://doi.org/10.1016/j.socnet.2007.05.001'),
('J. H. Fowler et al., "Network Analysis and the Law: Measuring the Legal Importance of Supreme Court Precedents." Political Analysis 15(3), 324-346 (2007)', 'https://doi.org/10.1093/pan/mpm011')]
-icon_hash = '57114fb76afce8e9253875c7'
-ustream_license = None
+icon_hash = ['57114fb76afce8e9253875c7',
+ '571152dc6afce8e9253875c9']
+upstream_license = None
upstream_prefix = 'http://jhfowler.ucsd.edu/data'
files = [(('judicial.zip:allcites.txt', 'judicial.zip:judicial.csv'), "2008", 'loadtxt'),
(('Pol_Analysis_ussc_cites.csv.zip:Pol_Analysis_ussc_cites.csv',
@@ -56,12 +64,18 @@ def parse(alts=None):
vs = {g.vp.name[v] : v for v in g.vertices()}
if alt == "2008":
- vps = ["usid", "parties", "overruled", "overruling", "oxford"]
-
- for p in vps:
- g.vp[p] = g.new_vp("string")
+ # columns: caseid, usid, parties, year, overruled (the
+ # overruling case, 0 if none), overruling (space-separated
+ # list of overruled cases, 0 if none), oxford, liihc, ...
+ g.vp.usid = g.new_vp("string")
+ g.vp.parties = g.new_vp("string")
+ g.vp.year = g.new_vp("int")
+ g.vp.overruled = g.new_vp("int")
+ g.vp.overruling = g.new_vp("vector<int>")
+ g.vp.oxford = g.new_vp("bool")
+ g.vp.liihc = g.new_vp("bool")
- reader = csv.reader(io.TextIOWrapper(fs[1]))
+ reader = csv.reader(io.TextIOWrapper(fs[1], "utf8"))
next(reader)
for row in reader:
id = row[0]
@@ -69,34 +83,50 @@ def parse(alts=None):
v = vs[id]
except KeyError:
continue
- for p, val in zip(vps, row[1:len(vps)+1]):
- g.vp[p][v] = val
+ g.vp.usid[v] = row[1]
+ g.vp.parties[v] = row[2]
+ g.vp.year[v] = int(row[3])
+ g.vp.overruled[v] = int(row[4])
+ g.vp.overruling[v] = [int(x) for x in row[5].split()
+ if x != "0"]
+ g.vp.oxford[v] = row[6] == "1"
+ g.vp.liihc[v] = row[7] == "1"
+
+ g.vp.name = g.vp.name.copy("int")
else:
+ # the upstream file lists the cited case first; edges are
+ # reversed to point from the citing to the cited case
+ g.set_reversed(True)
+ g = Graph(g, prune=True)
+
g.vp.lexid = g.vp.name
del g.vp["name"]
- vps = ["usid", "name", "amiciz_num", "auth_num", "oxford_num",
- "cq_num", "nyt_num", "insc_num", "apin_num", "stin_num",
- "citedyr_num", "citingyr_num", "size_num", "age",
- "insc_num_lag", "apin_num_lag", "stin_num_lag",
- "outsc_num_lag", "sc_cumul_cites_lag"]
+ vs = {g.vp.lexid[v] : v for v in g.vertices()}
+
+ svps = ["usid", "name"]
+ nvps = ["amiciz_num", "auth_num", "oxford_num", "cq_num",
+ "nyt_num", "insc_num", "apin_num", "stin_num",
+ "citedyr_num", "citingyr_num", "size_num", "age",
+ "insc_num_lag", "apin_num_lag", "stin_num_lag",
+ "outsc_num_lag", "sc_cumul_cites_lag"]
- for p in vps:
+ for p in svps:
g.vp[p] = g.new_vp("string")
+ for p in nvps:
+ g.vp[p] = g.new_vp("double", val=numpy.nan)
+ # the replication data are a panel with one row per case
+ # and year of measurement; the last year (2005) is used
df = pandas.read_stata(fs[1])
- for index, row in df.iterrows():
+ df = df.sort_values("citingyr_num", kind="stable")
+ df = df.groupby("lexid").tail(1)
+ for row in df.itertuples(index=False):
try:
- v = vs[row["lexid"]]
+ v = vs[row.lexid]
except KeyError:
continue
- for p in vps:
- g.vp[p][v] = row[p]
-
- for p in g.vp.keys():
- try:
- g.vp[p] = g.vp[p].copy("int")
- except ValueError:
- continue
+ for p in svps + nvps:
+ g.vp[p][v] = getattr(row, p)
yield alt, g
Update copyright information 73a4f0d
diff --git a/entries/scotus_majority/__init__.py b/entries/scotus_majority/__init__.py
index 3b40e2e..d4a8806 100644
--- a/entries/scotus_majority/__init__.py
+++ b/entries/scotus_majority/__init__.py
@@ -1,7 +1,7 @@
#! /usr/bin/env python
# -*- coding: utf-8 -*-
#
-# Copyright (C) 2020-2024 Tiago de Paula Peixoto <tiago@skewed.de>
+# Copyright (C) 2020-2026 Tiago de Paula Peixoto <tiago@skewed.de>
#
# This program is free software: you can redistribute it and/or modify it under
# the terms of the GNU Affero General Public License as published by the Free
Update copyright information 3d288ea
diff --git a/entries/scotus_majority/__init__.py b/entries/scotus_majority/__init__.py
index c912c29..3b40e2e 100644
--- a/entries/scotus_majority/__init__.py
+++ b/entries/scotus_majority/__init__.py
@@ -1,7 +1,7 @@
#! /usr/bin/env python
# -*- coding: utf-8 -*-
#
-# Copyright (C) 2020-2023 Tiago de Paula Peixoto <tiago@skewed.de>
+# Copyright (C) 2020-2024 Tiago de Paula Peixoto <tiago@skewed.de>
#
# This program is free software: you can redistribute it and/or modify it under
# the terms of the GNU Affero General Public License as published by the Free
Update copyright information 8d005ae
diff --git a/entries/scotus_majority/__init__.py b/entries/scotus_majority/__init__.py
index ab05ccf..c912c29 100644
--- a/entries/scotus_majority/__init__.py
+++ b/entries/scotus_majority/__init__.py
@@ -1,7 +1,7 @@
#! /usr/bin/env python
# -*- coding: utf-8 -*-
#
-# Copyright (C) 2021 Tiago de Paula Peixoto <tiago@skewed.de>
+# Copyright (C) 2020-2023 Tiago de Paula Peixoto <tiago@skewed.de>
#
# This program is free software: you can redistribute it and/or modify it under
# the terms of the GNU Affero General Public License as published by the Free
Update copyright info db2efcc
diff --git a/entries/scotus_majority/__init__.py b/entries/scotus_majority/__init__.py
index f7caa8b..ab05ccf 100644
--- a/entries/scotus_majority/__init__.py
+++ b/entries/scotus_majority/__init__.py
@@ -1,7 +1,7 @@
#! /usr/bin/env python
# -*- coding: utf-8 -*-
#
-# Copyright (C) 2020 Tiago de Paula Peixoto <tiago@skewed.de>
+# Copyright (C) 2021 Tiago de Paula Peixoto <tiago@skewed.de>
#
# This program is free software: you can redistribute it and/or modify it under
# the terms of the GNU Affero General Public License as published by the Free
Update citations to use DOIs e878874
diff --git a/entries/scotus_majority/__init__.py b/entries/scotus_majority/__init__.py
index 21d8652..f7caa8b 100644
--- a/entries/scotus_majority/__init__.py
+++ b/entries/scotus_majority/__init__.py
@@ -25,8 +25,8 @@ description = """Network of legal citations among majority opinions written by t
[^icon]: Description obtained from the [ICON](https://icon.colorado.edu) project."""
tags = ['Informational', 'Legal', 'Unweighted', 'Metadata', 'Temporal']
url = 'http://fowler.ucsd.edu/judicial.htm'
-citation = [('J. H. Fowler and S. Jeon, "The Authority of Supreme Court Precedent." Social Networks 30(1), 16-30 (2008)', 'http://jhfowler.ucsd.edu/authority_of_supreme_court_precedent.pdf'),
- ('J. H. Fowler et al., "Network Analysis and the Law: Measuring the Legal Importance of Supreme Court Precedents." Political Analysis 15(3), 324-346 (2007)', 'http://jhfowler.ucsd.edu/network_analysis_and_the_law.pdf')]
+citation = [('J. H. Fowler and S. Jeon, "The Authority of Supreme Court Precedent." Social Networks 30(1), 16-30 (2008)', 'https://doi.org/10.1016/j.socnet.2007.05.001'),
+ ('J. H. Fowler et al., "Network Analysis and the Law: Measuring the Legal Importance of Supreme Court Precedents." Political Analysis 15(3), 324-346 (2007)', 'https://doi.org/10.1093/pan/mpm011')]
icon_hash = '57114fb76afce8e9253875c7'
ustream_license = None
upstream_prefix = 'http://jhfowler.ucsd.edu/data'
Add scotus_majority 8d47da1
diff --git a/entries/scotus_majority/__init__.py b/entries/scotus_majority/__init__.py
new file mode 100644
index 0000000..21d8652
--- /dev/null
+++ b/entries/scotus_majority/__init__.py
@@ -0,0 +1,102 @@
+#! /usr/bin/env python
+# -*- coding: utf-8 -*-
+#
+# Copyright (C) 2020 Tiago de Paula Peixoto <tiago@skewed.de>
+#
+# This program is free software: you can redistribute it and/or modify it under
+# the terms of the GNU Affero General Public License as published by the Free
+# Software Foundation, either version 3 of the License, or (at your option) any
+# later version.
+#
+# This program is distributed in the hope that it will be useful, but WITHOUT
+# ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS
+# FOR A PARTICULAR PURPOSE. See the GNU Affero General Public License for more
+# details.
+#
+# You should have received a copy of the GNU Affero General Public License along
+# with this program. If not, see <http://www.gnu.org/licenses/>.
+
+from .. import *
+
+import pandas
+
+title = "SCOTUS majority opinions"
+description = """Network of legal citations among majority opinions written by the Supreme Court of the United States (SCOTUS), from 1754-2002 (2008 version) and 1792-2006 (2007 version). In addition to the citation network, node metadata is included giving some description of each opinion.[^icon]
+[^icon]: Description obtained from the [ICON](https://icon.colorado.edu) project."""
+tags = ['Informational', 'Legal', 'Unweighted', 'Metadata', 'Temporal']
+url = 'http://fowler.ucsd.edu/judicial.htm'
+citation = [('J. H. Fowler and S. Jeon, "The Authority of Supreme Court Precedent." Social Networks 30(1), 16-30 (2008)', 'http://jhfowler.ucsd.edu/authority_of_supreme_court_precedent.pdf'),
+ ('J. H. Fowler et al., "Network Analysis and the Law: Measuring the Legal Importance of Supreme Court Precedents." Political Analysis 15(3), 324-346 (2007)', 'http://jhfowler.ucsd.edu/network_analysis_and_the_law.pdf')]
+icon_hash = '57114fb76afce8e9253875c7'
+ustream_license = None
+upstream_prefix = 'http://jhfowler.ucsd.edu/data'
+files = [(('judicial.zip:allcites.txt', 'judicial.zip:judicial.csv'), "2008", 'loadtxt'),
+ (('Pol_Analysis_ussc_cites.csv.zip:Pol_Analysis_ussc_cites.csv',
+ 'Pol_Analysis_replication.zip:Pol_Analysis_replication.dta'), "2007", 'csv')]
+
+def fetch_upstream(force=False):
+ return fetch_upstream_files(__name__.split(".")[-1], upstream_prefix, files,
+ force)
+
+@cache_network()
+@coerce_props()
+@annotate()
+def parse(alts=None):
+ global files
+ name = __name__.split(".")[-1]
+ for fnames, alt, fmt in files:
+ if alts is not None and alt not in alts:
+ continue
+ if isinstance(fnames, str):
+ fnames = [fnames]
+ with ExitStack() as stack:
+ fs = [stack.enter_context(open_upstream_file(name, fn, "rb")) for fn in fnames]
+ g = parse_graph([fs[0]], fmt, directed=True)
+
+ vs = {g.vp.name[v] : v for v in g.vertices()}
+
+ if alt == "2008":
+ vps = ["usid", "parties", "overruled", "overruling", "oxford"]
+
+ for p in vps:
+ g.vp[p] = g.new_vp("string")
+
+ reader = csv.reader(io.TextIOWrapper(fs[1]))
+ next(reader)
+ for row in reader:
+ id = row[0]
+ try:
+ v = vs[id]
+ except KeyError:
+ continue
+ for p, val in zip(vps, row[1:len(vps)+1]):
+ g.vp[p][v] = val
+ else:
+ g.vp.lexid = g.vp.name
+ del g.vp["name"]
+
+ vps = ["usid", "name", "amiciz_num", "auth_num", "oxford_num",
+ "cq_num", "nyt_num", "insc_num", "apin_num", "stin_num",
+ "citedyr_num", "citingyr_num", "size_num", "age",
+ "insc_num_lag", "apin_num_lag", "stin_num_lag",
+ "outsc_num_lag", "sc_cumul_cites_lag"]
+
+ for p in vps:
+ g.vp[p] = g.new_vp("string")
+
+ df = pandas.read_stata(fs[1])
+ for index, row in df.iterrows():
+ try:
+ v = vs[row["lexid"]]
+ except KeyError:
+ continue
+ for p in vps:
+ g.vp[p][v] = row[p]
+
+ for p in g.vp.keys():
+ try:
+ g.vp[p] = g.vp[p].copy("int")
+ except ValueError:
+ continue
+
+ yield alt, g