logo Netzschleuder network catalog, repository, and centrifuge

History of islamic_state_europe

The changes to the source code of this entry in the repository, newest first, each with the differences it made to the entry's files. They are also listed on GitLab.

[entries] Remove superfluous details of the upstream distribution from the descriptions by Tiago de Paula Peixoto dc07aa0
The descriptions mentioned incidental details of how the upstream data
are made available: the file formats (CSV, JSON, XML, GEXF, SBML, HIF,
Pajek, UCINET, ...), file names, where the files were published or
obtained from (Zenodo, figshare, Kaggle, the Pajek datasets page, the
Internet Archive), and that some networks are only available in the gt
format. These are left out; caveats about the data themselves are kept,
referring to "the data" instead of "the file". The description of
sp_baboons now lists its properties instead of the upstream columns,
and says that events without a recipient are left out.
diff --git a/entries/islamic_state_europe/__init__.py b/entries/islamic_state_europe/__init__.py
index bd04fc0..5938af8 100644
--- a/entries/islamic_state_europe/__init__.py
+++ b/entries/islamic_state_europe/__init__.py
@@ -25,7 +25,7 @@ description = """Networks of the individuals involved in the terrorist attacks c
 - `restricted` (IS-E restricted): as `network`, but without the ties based on shared sites.
 - `extended` (IS-E extended): as `network`, plus ties between suspects present in the same locality (e.g. the Molenbeek district of Brussels).
 
-All networks contain the same nodes: all persons in the data whose status is not "free" (i.e. arrested, dead or wanted), plus one person with status "free" who has ties, as in the GML files of the authors. Persons without ties under a given rule are isolated nodes. One self-loop of the source data in the `extended` network (a person tied to themself by a shared locality) is removed. This is the latest version of the data, as of August 2017 (the ICON record refers to an earlier version of November 2015, with 24 nodes and 35 edges).
+All networks contain the same nodes: all persons in the data whose status is not "free" (i.e. arrested, dead or wanted), plus one person with status "free" who has ties, as in the networks of the authors. Persons without ties under a given rule are isolated nodes. One self-loop of the source data in the `extended` network (a person tied to themself by a shared locality) is removed. This is the latest version of the data, as of August 2017 (the ICON record refers to an earlier version of November 2015, with 24 nodes and 35 edges).
 
 The networks have the following properties:
 
[entries] Add the date when each entry was added, and remove icon_hash by Tiago de Paula Peixoto beff7c9
The dates are those of the commits that first added the entries' files
(2020-08-11 for the entries of the initial commit); renamed entries keep
the date of their first name.

Changed: none
diff --git a/entries/islamic_state_europe/__init__.py b/entries/islamic_state_europe/__init__.py
index 067b8bb..bd04fc0 100644
--- a/entries/islamic_state_europe/__init__.py
+++ b/entries/islamic_state_europe/__init__.py
@@ -49,7 +49,7 @@ The networks have the following properties:
 tags = ['Social', 'Offline', 'Unweighted', 'Metadata']
 url = 'https://github.com/sashagutfraind/Nov13'
 citation = [('A. Gutfraind, M. Genkin, "A graph database framework for covert network analysis: An application to the Islamic State network in Europe." Social Networks 51, 178-188 (2017)', 'https://doi.org/10.1016/j.socnet.2016.10.004')]
-icon_hash = '56a85c8e26855e083a2f7959'
+date_added = '2026-10-25'
 upstream_license = ("CC BY 4.0", "https://github.com/sashagutfraind/Nov13/blob/bc1d58acee7e12b7cd106f1ec79f117a5807bfeb/LICENSE.md")
 # sashagutfraind/Nov13 repository at a fixed commit
 upstream_prefix = 'https://raw.githubusercontent.com/sashagutfraind/Nov13/bc1d58acee7e12b7cd106f1ec79f117a5807bfeb'
[entries] Prefix the properties in the descriptions with (Node), (Edge) or (Graph) by Tiago de Paula Peixoto bc3dbbd
The lists of properties at the end of the descriptions marked edge
properties with "Edge" but left node properties unmarked, or grouped
them in "Nodes: `a`, ...; `b`, ..." items, so the kind of a property
was often unclear. Every item now starts with (Node), (Edge) or (Graph),
followed by the property names, a colon and the explanation, one item
per property or group of properties; qualifications (kinds of nodes,
networks) follow the names in parentheses. Properties that were only
named got a short explanation, and a few items that named the wrong
kind of property were corrected.
diff --git a/entries/islamic_state_europe/__init__.py b/entries/islamic_state_europe/__init__.py
index 3f7eab7..067b8bb 100644
--- a/entries/islamic_state_europe/__init__.py
+++ b/entries/islamic_state_europe/__init__.py
@@ -29,8 +29,23 @@ All networks contain the same nodes: all persons in the data whose status is not
 
 The networks have the following properties:
 
-- Nodes: `name`, the name of the person (sometimes only partially known, or a placeholder description); `age`, the age of the person (-1 if unknown); `citizenship`; `status`, "arrested", "dead", "wanted" or "free"; `role`, the role of the person, if known (e.g. "logistics", "commander", "bomb maker"); `ref`, the media source reporting on the person; `attacker`, whether the person was involved in an attack; `involved_in_activity`, whether the person was involved in an activity; `linked_to_attacker`, whether the person (a suspect) is linked to an attacker.
-- Edges: boolean flags for the grounds of each tie (several can apply): `common_attack` (involved in an attack on the same site), `linked_to_attacker` (pre-existing link of a suspect with an attacker), `linked_to_each_other` (any pre-existing link between the two persons; not used by itself as a ground for a tie), `linked_to_wanted` (pre-existing link of a suspect with a wanted or dead person), `common_involvement` (involved in the same activity), `shared_site_with_attacker` (a suspect present in the same site as an attacker), `shared_site_with_suspect` (two suspects related to the same site), `shared_locality_with_suspect` (two suspects present in the same locality)."""
+- (Node) `name`: the name of the person (sometimes only partially known, or a placeholder description).
+- (Node) `age`: the age of the person (-1 if unknown).
+- (Node) `citizenship`: the citizenship of the person.
+- (Node) `status`: "arrested", "dead", "wanted" or "free".
+- (Node) `role`: the role of the person, if known (e.g. "logistics", "commander", "bomb maker").
+- (Node) `ref`: the media source reporting on the person.
+- (Node) `attacker`: whether the person was involved in an attack.
+- (Node) `involved_in_activity`: whether the person was involved in an activity.
+- (Node) `linked_to_attacker`: whether the person (a suspect) is linked to an attacker.
+- (Edge) `common_attack`: a boolean flag for a ground of the tie (several can apply): involved in an attack on the same site.
+- (Edge) `linked_to_attacker`: likewise, pre-existing link of a suspect with an attacker.
+- (Edge) `linked_to_each_other`: likewise, any pre-existing link between the two persons (not used by itself as a ground for a tie).
+- (Edge) `linked_to_wanted`: likewise, pre-existing link of a suspect with a wanted or dead person.
+- (Edge) `common_involvement`: likewise, involved in the same activity.
+- (Edge) `shared_site_with_attacker`: likewise, a suspect present in the same site as an attacker.
+- (Edge) `shared_site_with_suspect`: likewise, two suspects related to the same site.
+- (Edge) `shared_locality_with_suspect`: likewise, two suspects present in the same locality."""
 tags = ['Social', 'Offline', 'Unweighted', 'Metadata']
 url = 'https://github.com/sashagutfraind/Nov13'
 citation = [('A. Gutfraind, M. Genkin, "A graph database framework for covert network analysis: An application to the Islamic State network in Europe." Social Networks 51, 178-188 (2017)', 'https://doi.org/10.1016/j.socnet.2016.10.004')]
[entries] Remove unneeded code from the entries by Tiago de Paula Peixoto 2c69f19
Unneeded "global files" statements, unused imports and variables,
f-strings without placeholders, duplicate keys in foodweb_little_rock
(keeping the order and the values used), and the second definition of
get_lines() in twitter_higgs. Nothing changes in the networks or
descriptions.

Changed: none
diff --git a/entries/islamic_state_europe/__init__.py b/entries/islamic_state_europe/__init__.py
index f9c58ae..3f7eab7 100644
--- a/entries/islamic_state_europe/__init__.py
+++ b/entries/islamic_state_europe/__init__.py
@@ -66,7 +66,6 @@ _node_flags = [("attackerNodes", "attacker"),
 @coerce_props()
 @annotate()
 def parse(alts=None):
-    global files
     name = __name__.split(".")[-1]
     for fnames, alt, fmt in files:
         if alts is not None and alt not in alts:
[entries] New entry: islamic_state_europe by Tiago de Paula Peixoto 11c8880
diff --git a/entries/islamic_state_europe/__init__.py b/entries/islamic_state_europe/__init__.py
new file mode 100644
index 0000000..f9c58ae
--- /dev/null
+++ b/entries/islamic_state_europe/__init__.py
@@ -0,0 +1,113 @@
+#! /usr/bin/env python
+# -*- coding: utf-8 -*-
+#
+# Copyright (C) 2020-2026 Tiago de Paula Peixoto <tiago@skewed.de>
+#
+# This program is free software: you can redistribute it and/or modify it under
+# the terms of the GNU Affero General Public License as published by the Free
+# Software Foundation, either version 3 of the License, or (at your option) any
+# later version.
+#
+# This program is distributed in the hope that it will be useful, but WITHOUT
+# ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS
+# FOR A PARTICULAR PURPOSE.  See the GNU Affero General Public License for more
+# details.
+#
+# You should have received a copy of the GNU Affero General Public License along
+# with this program.  If not, see <http://www.gnu.org/licenses/>.
+
+from .. import *
+
+title = "Islamic State network in Europe (2014-2016)"
+description = """Networks of the individuals involved in the terrorist attacks carried out in Europe by the Islamic State (IS) network that perpetrated the attacks of November 13, 2015 in Paris and of March 22, 2016 in Brussels (called IS in Europe, or IS-E, by the authors), compiled by Alexander Gutfraind and Michael Genkin. Besides the Paris and Brussels attacks, the network includes related operations such as the attack on the Jewish Museum of Belgium (May 2014), the interdicted plot in Verviers (January 2015), and the attack on the Brussels-Paris high-speed train (August 2015). The data were coded from large-circulation media sources (mostly French, Dutch and English-language newspapers, and the Lexis database), collected from November 17, 2015 to May 9, 2016, into a graph database of persons, attacks, covert or non-covert activities, sites (e.g. residences and safe houses), localities and countries, with relations such as a person involved in an attack or activity, linked to another person (kinship, affinity, operational work), or present in a site or locality. Persons were included if they were attackers, involved with an attacker in a terrorism-related task, or wanted or arrested in relation to the attacks. The social networks between persons were then inferred from the database. Nodes are persons, and undirected edges are inferred ties, obtained with three different rules for the sensitivity analysis of the authors:
+
+- `network` (IS-E): two persons are tied if they took part in an attack on the same site, were involved in the same activity, had a pre-existing link and one of them is an attacker or a wanted or dead member, or shared a site (e.g. a residence or safe house) and are both suspects, or one is an attacker.
+- `restricted` (IS-E restricted): as `network`, but without the ties based on shared sites.
+- `extended` (IS-E extended): as `network`, plus ties between suspects present in the same locality (e.g. the Molenbeek district of Brussels).
+
+All networks contain the same nodes: all persons in the data whose status is not "free" (i.e. arrested, dead or wanted), plus one person with status "free" who has ties, as in the GML files of the authors. Persons without ties under a given rule are isolated nodes. One self-loop of the source data in the `extended` network (a person tied to themself by a shared locality) is removed. This is the latest version of the data, as of August 2017 (the ICON record refers to an earlier version of November 2015, with 24 nodes and 35 edges).
+
+The networks have the following properties:
+
+- Nodes: `name`, the name of the person (sometimes only partially known, or a placeholder description); `age`, the age of the person (-1 if unknown); `citizenship`; `status`, "arrested", "dead", "wanted" or "free"; `role`, the role of the person, if known (e.g. "logistics", "commander", "bomb maker"); `ref`, the media source reporting on the person; `attacker`, whether the person was involved in an attack; `involved_in_activity`, whether the person was involved in an activity; `linked_to_attacker`, whether the person (a suspect) is linked to an attacker.
+- Edges: boolean flags for the grounds of each tie (several can apply): `common_attack` (involved in an attack on the same site), `linked_to_attacker` (pre-existing link of a suspect with an attacker), `linked_to_each_other` (any pre-existing link between the two persons; not used by itself as a ground for a tie), `linked_to_wanted` (pre-existing link of a suspect with a wanted or dead person), `common_involvement` (involved in the same activity), `shared_site_with_attacker` (a suspect present in the same site as an attacker), `shared_site_with_suspect` (two suspects related to the same site), `shared_locality_with_suspect` (two suspects present in the same locality)."""
+tags = ['Social', 'Offline', 'Unweighted', 'Metadata']
+url = 'https://github.com/sashagutfraind/Nov13'
+citation = [('A. Gutfraind, M. Genkin, "A graph database framework for covert network analysis: An application to the Islamic State network in Europe." Social Networks 51, 178-188 (2017)', 'https://doi.org/10.1016/j.socnet.2016.10.004')]
+icon_hash = '56a85c8e26855e083a2f7959'
+upstream_license = ("CC BY 4.0", "https://github.com/sashagutfraind/Nov13/blob/bc1d58acee7e12b7cd106f1ec79f117a5807bfeb/LICENSE.md")
+# sashagutfraind/Nov13 repository at a fixed commit
+upstream_prefix = 'https://raw.githubusercontent.com/sashagutfraind/Nov13/bc1d58acee7e12b7cd106f1ec79f117a5807bfeb'
+
+_common = ('ise_allPersons.csv', 'ise_networkNodeDetails.csv',
+           'ise_networkTieDetails.csv')
+files = [(_common + ('ise_terrorNetwork.csv',), 'network', None),
+         (_common + ('ise_terrorNetworkLimited.csv',), 'restricted', None),
+         (_common + ('ise_terrorNetworkExtended.csv',), 'extended', None)]
+
+def fetch_upstream(force=False):
+    return fetch_upstream_files(__name__.split(".")[-1], upstream_prefix, files,
+                                force)
+
+_tie_flags = [("commonAttack", "common_attack"),
+              ("linkedToAttacker", "linked_to_attacker"),
+              ("linkedToEachOther", "linked_to_each_other"),
+              ("linkedToWanted", "linked_to_wanted"),
+              ("commonInvolvement", "common_involvement"),
+              ("sharedSiteWithAttacker", "shared_site_with_attacker"),
+              ("sharedSiteWithSuspect", "shared_site_with_suspect"),
+              ("sharedLocalityWithSuspect", "shared_locality_with_suspect")]
+
+_node_flags = [("attackerNodes", "attacker"),
+               ("involvedInActivityNodes", "involved_in_activity"),
+               ("linkedToAttackerNodes", "linked_to_attacker")]
+
+@cache_network()
+@coerce_props()
+@annotate()
+def parse(alts=None):
+    global files
+    name = __name__.split(".")[-1]
+    for fnames, alt, fmt in files:
+        if alts is not None and alt not in alts:
+            continue
+        with ExitStack() as stack:
+            persons, ndetails, tdetails, edges = \
+                [list(csv.DictReader(io.TextIOWrapper(stack.enter_context(open_upstream_file(name, fn, "rb")),
+                                                      encoding="latin-1")))
+                 for fn in fnames]
+        na = lambda x: "" if x == "NA" else x.strip()
+        pers = {p["p.name"]: p for p in persons}
+        ndet = {r["node"]: r for r in ndetails}
+        tdet = {(r["n1"], r["n2"]): r for r in tdetails}
+        edges = [(r["n1"], r["n2"]) for r in edges if r["n1"] != r["n2"]]
+
+        names = [p["p.name"] for p in persons if p["p.status"] != "free"]
+        for e in edges:
+            for n in e:
+                if n not in names:
+                    names.append(n)
+        idx = {n: i for i, n in enumerate(names)}
+
+        g = Graph(directed=False)
+        g.add_vertex(len(names))
+        g.vp.name = g.new_vp("string", vals=names)
+        g.vp.age = g.new_vp("int", vals=[int(pers[n]["p.age"]) if pers.get(n, {}).get("p.age", "NA") != "NA" else -1
+                                         for n in names])
+        for k in ["citizenship", "status", "role"]:
+            vals = [na(pers[n][f"p.{k}"]) if n in pers else "" for n in names]
+            if k == "status":
+                # fix a typo in the source data
+                vals = ["arrested" if x == "arreted" else x for x in vals]
+            g.vp[k] = g.new_vp("string", vals=vals)
+        g.vp.ref = g.new_vp("string", vals=[na(pers[n]["p.ref1"]) if n in pers else "" for n in names])
+        for k, pk in _node_flags:
+            g.vp[pk] = g.new_vp("bool", vals=[ndet[n][k] == "TRUE" if n in ndet else False
+                                              for n in names])
+
+        eprops = [g.new_ep("bool") for k, pk in _tie_flags]
+        for (k, pk), p in zip(_tie_flags, eprops):
+            g.ep[pk] = p
+        g.add_edge_list([(idx[a], idx[b]) + tuple(tdet[(a, b)][k] == "TRUE" for k, pk in _tie_flags)
+                         for a, b in edges], eprops=eprops)
+        yield alt, g