a model-independent general search for new phenomena with ... · to a global significance of less...

26
ATLAS-CONF-2017-001 31 January 2017 ATLAS CONF Note ATLAS-PHYS-CONF-2017-001 A model-independent general search for new phenomena with the ATLAS detector at s = 13 TeV The ATLAS Collaboration 30th January 2017 This note presents results of a model-independent general search for new physics using 3.2 fb -1 of proton-proton collision data at a centre-of-mass energy of 13 TeV with the ATLAS detector at the LHC. Event topologies involving isolated leptons (electrons and muons), photons, jets, b-tagged jets and missing transverse momentum, leading to 639 dierent fi- nal states, are investigated. For each final state, a search algorithm tests the compatibility of data against the Monte Carlo simulated background in two kinematic variables sensitive to new physics eects. The expected frequency of the maximal local significance observed in each channel is estimated using pseudo-experiments generated assuming the Standard Model prediction. The largest observed discrepancy, with a local p 0 -value of 5 · 10 -4 , corresponds to a global significance of less than one sigma. © 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction of this article or parts of it is allowed as specified in the CC-BY-4.0 license.

Upload: others

Post on 22-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

ATL

AS-

CO

NF-

2017

-001

31Ja

nuar

y20

17

ATLAS CONF NoteATLAS-PHYS-CONF-2017-001

A model-independent general search for newphenomena with the ATLAS detector at

√s = 13 TeV

The ATLAS Collaboration

30th January 2017

This note presents results of a model-independent general search for new physics using3.2 fb−1 of proton-proton collision data at a centre-of-mass energy of 13 TeV with the ATLASdetector at the LHC. Event topologies involving isolated leptons (electrons and muons),photons, jets, b-tagged jets and missing transverse momentum, leading to 639 different fi-nal states, are investigated. For each final state, a search algorithm tests the compatibility ofdata against the Monte Carlo simulated background in two kinematic variables sensitive tonew physics effects. The expected frequency of the maximal local significance observed ineach channel is estimated using pseudo-experiments generated assuming the Standard Modelprediction. The largest observed discrepancy, with a local p0-value of 5 · 10−4, correspondsto a global significance of less than one sigma.

© 2017 CERN for the benefit of the ATLAS Collaboration.Reproduction of this article or parts of it is allowed as specified in the CC-BY-4.0 license.

Page 2: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

1 Introduction

Direct searches for as yet unknown particles and forces are one of the primary objectives of the ATLASphysics program. The ATLAS experiment at the Large Hadron Collider (LHC) has thoroughly analyzedthe Run-1 dataset and a small fraction of the expected Run-2 dataset and no evidence of physics beyondthe Standard Model (SM) has been found so far in any of the searches performed.

The existing searches do not fully cover the enormous parameter space of masses, cross-sections anddecay possibilities of all possible new particles. Signals might be hidden in so far unexplored kinematicregimes and final states, motivating a structured, global and automated way to search for new physics.

Such an analysis detects discrepancies between data and the prediction which serve as an alert to performmore precise and model-dependent analyses in the potentially interesting final states.

This note presents a model-independent general search for deviations from the Standard Model predictionin 13 TeV proton-proton collision data collected with the ATLAS detector in 2015, corresponding toan integrated luminosity of 3.2 fb−1. The analysis partitions all recorded events into exclusive classesaccording to the number of high transverse momentum (pT) reconstructed objects: electrons, muons,photons, jets, b-tagged jets and missing transverse momentum (Emiss

T ). The distributions of the effectivemass (meff) and the visible invariant mass (minv) of the event are investigated systematically for each class.A statistical search algorithm is used to locate the region of largest deviation from the SM prediction inthese distributions. Monte Carlo (MC) simulation is used to model the SM backgrounds. The probabilityto measure a deviation with a significance equal of bigger than the observed one is estimated by comparingdata results with pseudo-experiment predictions.

Model-independent searches have been previously performed by the H1 Collaboration [1, 2] at HERA andby the D0 [3–5] and CDF [6, 7] Collaborations at the Tevatron. At the LHC model-independent searcheshave been performed by the CMS Collaboration at

√s=7 TeV [8] and by the ATLAS Collaboration at 7

and 8 TeV [9, 10].

The note is organized as follows. An overview of the ATLAS detector is given in Section 2, followed bya description of the dataset and triggers used in 3. The MC samples used are described in Section 4, andthe object definitions in Section 5. Systematic uncertainties are presented in Section 6. Next, in Section 7,the classification of events according to the reconstructed objects is presented. In Section 8 the statisticalinterpretation is discussed and conclusions are presented in Section 9.

2 ATLAS detector

The ATLAS detector [11] is a multi-purpose particle physics detector with a forward-backward symmetriccylindrical geometry and nearly 4π coverage in solid angle∗. The inner tracking detector (ID) consistsof pixel and silicon microstrip detectors covering the pseudorapidity region |η | < 2.5, surrounded by atransition radiation tracker which enhances electron identification in the region |η | < 2.0. Between Run-1

∗ ATLAS uses a right-handed coordinate system with its origin at the nominal interaction point in the centre of the detector.The positive x-axis is defined by the direction from the interaction point to the centre of the LHC ring, with the positivey-axis pointing upwards, while the beam direction defines the z-axis. Cylindrical coordinates (r , φ) are used in the transverseplane, φ being the azimuthal angle around the z-axis. The pseudorapidity η is defined in terms of the polar angle θ byη = − ln tan(θ/2). Rapidity is defined as y = 0.5 · ln[(E + pz )/(E − pz )] where E denotes the energy and pz is the componentof the momentum along the beam direction.

2

Page 3: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

and Run-2, a new inner pixel layer, the Insertable B-Layer (IBL) [12], was inserted at a mean sensorradius of 3.3 cm. The inner detector is surrounded by a thin superconducting solenoid providing an axial2 T magnetic field and by a fine-granularity lead/liquid-argon (LAr) electromagnetic calorimeter covering|η | < 3.2. A steel/scintillator-tile calorimeter provides hadronic coverage in the central pseudorapidityrange (|η | < 1.7). The endcap and forward regions (1.5 < |η | < 4.9) of the hadronic calorimeter aremade of LAr active layers with either copper or tungsten as the absorber material. An extensive muonspectrometer with an air-core toroid magnet system surrounds the calorimeters. Three layers of high-precision tracking chambers provide coverage in the range |η | < 2.7, while dedicated fast chambersallow triggering in the region |η | < 2.4. The ATLAS trigger system consists of a hardware-based level-1trigger followed by a software-based high-level trigger [13].

3 Dataset and trigger

The data used in this analysis were collected by the ATLAS detector in pp collisions at the LHC witha centre-of-mass energy of 13 TeV and a 25 ns bunch crossing interval during 2015. After applyingbeam-, data- and detector-quality criteria, the available dataset corresponds to an integrated luminosityof 3.2 fb−1. In this dataset, each event includes an average of approximately 14 additional inelastic ppcollisions in the same bunch crossing (pile-up).

Different triggers have been used to collect the events used in the analysis, with the aim of maximizing theacceptance for all the reconstructed objects considered. For an event passing more than one trigger, thefollowing priority list is applied, where for the definition of the objects the same requirements as in Sec. 5are applied. Events with reconstructed Emiss

T > 200 GeV are required to pass the EmissT trigger. If the

event fails the EmissT requirement but contains a signal muon with pT > 25 GeV it is taken from the single

muon trigger. Events with an electron with pT > 25 GeV but no reconstructed signal muons or largeEmiss

T are required to pass the single electron trigger. Remaining events with a photon with pT > 140 GeVor two photons with pT > 50 GeV are taken from the single and diphoton triggers, respectively. Finallyany remaining event with a jet with pT > 500 GeV is taken from the single jet trigger. In addition to thethresholds imposed by the trigger, a further selection is applied in final states containing only one leptonand jets, where the lepton is required to have pT > 100 GeV if the event has less than three jets withpT > 60 GeV.

4 Monte Carlo Samples

Monte Carlo simulated event samples are used for the description and estimation of SM background pro-cesses and to model the expected signals. The ATLAS detector is simulated [14] either by a softwaresystem based on GEANT4 [15] or by a faster simulation based on a parameterization [16] of the calor-imeter response and GEANT4 for the other detector systems. To account for additional pp interactionsfrom the same and close-by bunch crossings, a set of minimum-bias interactions generated using Pythia8.186 [17], the MSTW2008LO [18] parton distribution function (PDF) set and the A2 set of paramet-ers (tune) [19] is superimposed onto the hard scattering events to reproduce the observed distribution ofthe average number of interactions per bunch crossing. In all MC samples, except those produced bySherpa, the EvtGen v1.2.0 program [20] is used to model the properties of the bottom and charm hadrondecays.

3

Page 4: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

Samples of multijet production are simulated with 2 → 2 matrix elements (ME) at leading order (LO)using the Pythia 8.186 generator. The A14 tune [21] of shower and multiple parton interactions paramet-ers is used together with the NNPDF23LO PDF set [22]. Alternative multijet samples with 2→ 2 ME atLO are generated with Herwig 2.7.1 [23] with the UEEE5 underlying-event tune and the CTEQ6L1 [24]PDF set, and with Sherpa 2.1.1 with 2 → 3 ME at LO. All Sherpa samples use the CT10 [25] PDF setand the Sherpa parton shower [26] with a dedicated shower tuning developed by the Sherpa authors.

Events containing W or Z bosons with associated jets (W /Z+jets) are simulated using the Sherpa 2.1.1generator [27]. Matrix elements are calculated using the Comix [28] and Open-Loops [29] generat-ors. They include up to two partons at NLO and four partons at leading order (LO), merged using theME+PS@NLO prescription [30]. The W /Z+jets events are normalised to their inclusive next-to-next-to-leading-order (NNLO) cross-sections [31, 32]. Simulated samples of massive vector bosons produced inassociation with one or two real photons are also generated with Sherpa 2.1.1 with a ME calculated at LOfor up to three partons. They are scaled to their NLO cross-sections computed with MCFM [33, 34].

Samples of prompt photon production in association with jets (γ+jets) have been generated using Sherpa2.1.1. For these samples up to three real parton emissions are included at LO. Events containing twoprompt photons (γγ+jets) are also generated with Sherpa 2.1.1. Matrix elements are calculated with upto two partons at LO. The gluon-induced box process is also included. These samples are scaled to datawith the procedure described in Sec. 7.1.

Top pair production events, and single top quarks in the Wt and s-channel, are simulated using thePowheg-Box v2 [35] generator with the CT10 PDF set, as detailed in [36]. The top mass is set to172.5 GeV. The hdamp parameter, which regulates the transverse momentum of the first extra emissionbeyond the Born configuration and thus controls the pT of the tt̄ system, is set to the mass of the topquark. Electroweak t-channel single-top-quark events are generated using the Powheg-Box v1 generator.This generator uses the four-flavour scheme for the NLO matrix-element calculations together with thefixed four-flavour PDF set CT10f4. For all top-quark processes, top-quark spin correlations are preserved(for the single-top t-channel, top quarks are decayed using MadSpin [37]). An alternative sample of tt̄ isgenerated with the Sherpa 2.1.1 generator, including up to one additional parton at NLO and up to fouradditional partons at LO accuracy, interfaced to the parton shower using the ME+PS@NLO prescrip-tion. The parton shower (PS), fragmentation, and the underlying event of the Powheg-Box samples aresimulated using Pythia 6.428 [38] with the CTEQ6L1 PDF set and the corresponding Perugia 2012 tune(P2012) [39]. The tt̄ and single-top quark events are normalized to the NNLO order cross-section in-cluding the resummation of soft gluon emission at next-to-next-to-logarithmic accuracy using Top++2.0[40]. Both the default and the alternative tt̄ samples are corrected to reproduce the NNLO prediction [41,42] of the top quark pT and the pT of the tt̄ system, following the same procedure used in [43]. Thecontribution of tt̄ + bb̄ is generated separately with Sherpa 2.1.1 at NLO; the calculation is performed inthe four-flavor scheme and with the CT10f4 PDF set.

Diboson samples are generated with the Sherpa 2.1.1 generator, and are described in detail in [44]. Thematrix elements contain the doubly resonant WW , W Z and Z Z processes and all other diagrams withfour or six electroweak vertices (such as same-electric-charge W boson production in association withtwo jets, W±W± j j). Fully leptonic triboson processes (WWW , WW Z , W Z Z and Z Z Z) with up to sixcharged leptons are also simulated using Sherpa v2.1.1. The ME for the Z Z processes are calculated atNLO for up to one additional parton; final states with two and three additional partons are calculated atLO. The W Z and WW processes are calculated at NLO with up to three extra partons at LO using theME+PS@NLO prescription. The WW final states have been generated without bottom quarks in the hardscattering process, to avoid contributions from top-quark mediated processes. The triboson processes

4

Page 5: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

Table 1: A summary of the MC samples used in the analysis to model SM background processes. For each samplethe corresponding generator, parton shower, cross-section, PDF set and tune are indicated.

Physics process Generator Parton shower Cross-section PDF set Tunenormalisation

W (→ `ν) + jets Sherpa 2.1.1 Sherpa 2.1.1 NNLO NLO CT10 Sherpa defaultZ (→ ``) + jets Sherpa 2.1.1 Sherpa 2.1.1 NNLO NLO CT10 Sherpa defaultW /Z + γ(γ) Sherpa 2.1.1 Sherpa 2.1.1 NLO NLO CT10 Sherpa defaultγ(γ) + jets Sherpa 2.1.1 Sherpa 2.1.1 data NLO CT10 Sherpa defaultt t̄ Powheg-Box v2 Pythia 6.428 NNLO+NNLL NLO CT10 Perugia 2012t t̄ + bb̄ Sherpa 2.2.0 Pythia 6.428 NNLO+NNLL NLO CT10 Perugia 2012Single-top (t-channel) Powheg-Box v1 Pythia 6.428 NLO NLO CT10f4 Perugia 2012Single-top (s- and Wt-channel) Powheg-Box v2 Pythia 6.428 NLO NLO CT10 Perugia 2012t t̄ + W /Z/WW MG5_aMC@NLO 2.2.2 Pythia 8.186 NLO NNPDF2.3LO A14t t̄ + γ MG5_aMC@NLO 2.2.2 Pythia 8.186 LO NNPDF2.3LO A143-top, t Z MG5_aMC@NLO 2.2.2 Pythia 8.186 LO NNPDF2.3LO A144-top MG5_aMC@NLO 2.2.2 Pythia 8.186 NLO NNPDF2.3LO A14WW , WZ and ZZ Sherpa 2.1.1 Sherpa 2.1.1 NLO NLO CT10 Sherpa defaultMultijets Pythia 8.186 Pythia 8.186 data NNPDF2.3LO A14Higgs (ggF/VBF) Powheg-Box v2 Pythia 8.186 NNLO NLO CT10 AZNLOHiggs (t t̄H ) MG5_aMC@NLO 2.2.2 Herwig++ NNLO NLO CT10 UEEE5Higgs (W /ZH ) Pythia 8.186 Pythia 8.186 NNLO NNPDF2.3LO A14Tribosons Sherpa 2.1.1 Sherpa 2.1.1 NLO NLO CT10 Sherpa default

are calculated with the same configuration and with up to two extra partons at LO. The generator cross-sections are used for the normalization of these backgrounds.

Samples of top quark production in association with vector bosons [45] (W , Z , γ and WW , includingthe non-resonant Z/γ∗ contributions) are generated at LO with MG5_aMC@NLO v2.2.2 [46] interfacedto Pythia 8.186, with up to two (tt̄W ), one (tt̄ Z) or no (tt̄WW , tt̄γ) extra partons included in the matrixelement. The A14 tune is used together with the NNPDF2.3LO PDF set. The tt̄γ sample uses a fixedrenormalization and factorisation scale of 2 · mt , and the top decay is performed in MG5_aMC@NLOto account for hard photon radiation from the top decay products. The same generator is also used tosimulate the tZ , 3-top and 4-top quarks processes. The tt̄W , tt̄ Z , tt̄WW and 4-top samples are normalisedto their NLO cross-sections [47] while the LO cross-section from the generator is used for tZ and 3-topquarks.

The Higgs boson mass is set to 125 GeV and all Higgs boson decay modes are considered. The pro-duction of the SM Higgs boson in the ggF and VBF channels is modelled using the Powheg-Box v2generator, using the CT10 PDF set. It is interfaced to Pythia 8.186 with the CTEQ6L1 PDF set and theAZNLO tune [48]. Production of a Higgs boson in association with a pair of top quarks is simulated usingMG5_aMC@NLO v2.2.2 interfaced to Herwig 2.7.1 [23] for showering and hadronization. The UEEE5underlying-event tune is used together with the CT10 (matrix element) and CTEQ6L1 (parton shower)PDF sets. Simulated samples of SM Higgs boson production in association with a W or Z boson areproduced with Pythia 8.186, using the A14 tune and the NNPDF23LO PDF set. Events are normalisedto their most accurate cross-sections calculations (typically NNLO) [49].

To avoid double counting, events with a hard photon from final state radiation are removed from themultijet, tt̄ and W /Z+jet samples.

In addition to the SM background processes two possible signals are considered as benchmarks.

The first benchmark model considered is the production of a new heavy gauge boson (Z ′), as predicted bymany extensions of the SM. We consider the specific case of an E6 extension of the SM gauge group [50,

5

Page 6: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

51], which, after symmetry breaking, introduces two new neutral gauge bosons that mix with an angleθE . The two bosons are defined by Z ′ = Z ′ψ cos θE6 + Z ′χ sin θE6, and the specific choice of couplingscorresponding to θE6 = π is made, resulting in only the Z ′χ being produced. This process is generatedat LO using Pythia 8.186 with the NNPDF23LO PDF set and the A14 tune. Only decays of the Z ′ intoelectron or muon pairs are considered. Interference effects (such as with SM Drell-Yan production) arenot included.

The second signal considered is the supersymmetric [52–57] production of gluino pairs through stronginteractions. The gluinos are assumed to decay promptly into a pair of top quarks and a neutralino via anoff-shell top squark g̃ → tt χ̃0

1. Samples for this process are generated at LO with up to two additionalpartons using MG5_aMC@NLO v2.2.2 with the CTEQ6L1 PDF set, interfaced to Pythia 8.186 withthe A14 tune. The matching with the parton shower is done using the CKKW-L [58] prescription, witha matching scale set to one quarter of the pair-produced resonance mass. The signal cross-sections arecalculated at NLO in the strong coupling constant, adding the resummation of soft gluon emission atnext-to-leading-logarithmic (NLL) accuracy [59–61].

5 Object reconstruction

Candidate events are required to have a reconstructed vertex [62], with at least two associated trackswith pT > 400 MeV. The vertex with the highest sum of squared transverse momenta of the tracks isconsidered as the primary vertex.

Electron candidates are reconstructed from an isolated electromagnetic calorimeter energy deposit matchedto an ID track and are required to have |η | < 2.47, a transverse momentum pT > 10 GeV, and to passa loose likelihood-based identification requirement [63, 64]. The likelihood input variables include mea-surements of calorimeter shower shapes and measurements of track properties from the ID. The candidateelectrons are selected if the matched tracks have a transverse impact parameter significance with respectto the reconstructed primary vertex of |d0 |/σ(d0) < 5. Candidates within the transition region betweenthe barrel and endcap electromagnetic calorimeters, 1.37 < |η | < 1.52, are removed.

Muon candidates are reconstructed in the region |η | < 2.7 from muon spectrometer tracks matched to IDtracks. The muon candidates are selected if they have a transverse momentum above 10 GeV and passthe medium identification requirements defined in [65], based on selections on the number of hits in thedifferent ID and muon spectrometer subsystems, and the significance of the charge to momentum ratioq/p.

All candidate leptons (electrons and muons) are used for the object overlap removal described below.Further requirements are applied to the “signal” leptons used in the analyis as follows. Signal electronsmust satisfy a tight likelihood-based identification requirement [63, 64]. Signal muons must fulfil therequirement of |d0 |/σ(d0) < 3. The track associated to the signal leptons must have a longitudinal impactparameter with respect to the reconstructed primary vertex, z0, satisfying |z0 · sin θ | < 0.5 mm. Isolationrequirements are applied to both the signal electrons and muons. The calorimeter isolation is computedas the sum of the energies of calorimeter energy clusters in a cone of ∆R =

√(∆η)2 + (∆φ)2 = 0.2

around the lepton. Track isolation is defined as the scalar sum of the pT of tracks within a variable-sizecone around the lepton, in a cone of radius ∆R = 0.2 (0.3) for electron (muon) transverse momentapT < 50 GeV (pT < 33 GeV) and of radius ∆R = 10 GeV

pTfor pT > 50 GeV (pT > 33 GeV). The

efficiency of these criteria increases with the lepton transverse momentum, reaching 95% at 25 GeV and

6

Page 7: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

99% at 60 GeV, as determined in a control sample of Z decays into leptons selected with a tag-and-probetechnique [65, 66].

Photon candidates are reconstructed from calorimeter cell clusters and are required to satisfy the tightidentification criteria described in [67–69]. Furthermore, photons are required to have pT > 25 GeV and|η | < 2.37, excluding the barrel-endcap calorimeter transition in the range 1.37 < |η | < 1.52. Photonsmust further satisfy isolation criteria based on both track and calorimeter information [67]. After correct-ing for contributions from pile-up, the energy within a cone of ∆R = 0.4 around the cluster barycentreis required to be less than 2.45 GeV + 0.022 × pγT, where pγT is the transverse momentum of the photoncandidate. The energy of tracks in a cone of ∆R = 0.2 should be less than 0.05 × pγT.

Jets are reconstructed with the anti-kt algorithm [70] with radius parameter R = 0.4, using as inputthree-dimensional energy clusters in the calorimeter [71] calibrated to the electromagnetic scale. Thereconstructed jets are then calibrated to the jet energy scale (JES) derived from simulation and in-situcorrections based on 13 TeV data [72, 73]. For all jets the expected average energy contribution frompile-up clusters is subtracted according to the jet area prescription [74]. Quality criteria are imposed toidentify jets arising from non-collision sources or detector noise and any event containing such a jet isremoved [75]. All jets are required to have pT > 20 GeV and |η | < 2.8.

Identification of jets containing b-hadrons (b-tagging) is performed with a multivariate discriminant,MV2c20, making use of track impact parameters, the b- and c-hadron flight paths inside the jet andreconstructed secondary vertices [45, 76]. The algorithm working point used corresponds to a 77% aver-age efficiency obtained for b-jets in simulated tt̄ events. The rejection factors for light-quark jets, c-quarkjets and hadronically decaying τ leptons in simulated tt̄ events are approximately 140, 4.5 and 10, re-spectively [45]. Jets with |η | < 2.5 which satisfy this b-tagging requirement are identified as b-jets. Tocompensate for differences between data and MC simulation in the b-tagging efficiencies and mis-tagrates, correction factors are applied to the simulated samples [45].

After object identification, overlaps between objects are resolved. If an electron and a muon share thesame ID track, the electron is removed. Any jet within a distance ∆R = 0.2 of an electron candidate isdiscarded, unless the jet has a value of the MV2c20 discriminant larger than that corresponding to ap-proximately 85% b-tagging efficiency, in which case the electron is discarded since it is likely originatingfrom a semi-leptonic b-hadron decay. Any remaining electron within ∆R = 0.4 of a jet is discarded.Muons within ∆R = 0.4 of a jet are also removed. However, if the jet has fewer than three associatedtracks, the muon is kept and the jet is discarded instead to avoid inefficiencies for high-energy muonsundergoing significant energy loss in the calorimeter. If a photon candidate is found within ∆R = 0.4 ofa jet, the jet is discarded and the object is considered a photon. Photons within a cone of ∆R = 0.4 of anelectron or muon candidate are discarded.

The missing transverse momentum (and its magnitude EmissT ) is defined as the negative vector sum of

the transverse momenta of all selected and calibrated physics objects (electrons, photons, muons, jets) inthe event, with an additional soft-term [77, 78]. The soft-term is constructed from all tracks that are notassociated with any physics object, and that are associated with the primary vertex.

6 Systematic uncertainties

Uncertainties in the background estimate arise from experimental effects, and the prediction of the norm-alisation and acceptance. Their effect is evaluated for all the background processes used in the analysis

7

Page 8: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

as well as for the benchmark signals. Among the main systematic uncertainties on the total backgroundpredictions are the ones associated with the jet and b-tagging calibrations and the finite size of the MCsamples.

The dominant experimental systematic uncertainties arise from the limited knowledge of the jet energyscale (JES) and resolution (JER) and the scale and resolution of the Emiss

T soft-term. The jet uncertaintiesare derived as a function of pT and η of the jet, as well as of the pile-up conditions and the jet flavourcomposition of the selected jet sample. They are determined using a combination of simulated samplesand studies of data, such as measurements of the transverse jet balance in dijet, Z+jet and γ+jet events[72, 73]. The uncertainties on the b-tagging scale factors are determined in samples of top quark andsimulated events [45]. Leptonic decays of J/ψ and Z-bosons in data and simulation are exploited toestimate the uncertainties in lepton reconstruction, identification, momentum/energy scale and resolution,and isolation criteria [65, 66]. Photon reconstruction and identification efficiencies are evaluated fromsamples of Z → ee and Z + γ events [67, 79]. The uncertainty related to the modelling of Emiss

T in thesimulation is estimated by propagating the uncertainties on the energy and momentum scale of each of theobjects entering the calculation, with an additional uncertainty on the resolution and scale of the soft-term[77, 78]. The luminosity measurement was calibrated during dedicated beam-separation scans, using thesame methodology as that described in [80]. The uncertainty of this measurement is found to be 2.1%.

Two different sources of uncertainty in the theoretical modelling of the SM production processes areconsidered, as described in the following. A first uncertainty is assigned to account for the knowledge ofthe cross-section for the inclusive process. A second uncertainty, larger in most cases, is used to coveracceptance modelling. In order to derive the modelling uncertainties either variation of the scales usedto perform the calculation or comparisons of the nominal MC samples with alternative ones are used.The total uncertainty is taken as the quadratic sum of the two components. Uncertainties on the PDFshave been found to be negligible in all but the multijet samples, for which they have been explicitlyestimated.

The inclusive W and Z cross-sections are known at NNLO, with an uncertainty of about 5% [31, 32].Modelling uncertainties on W+jets and Z+jets are determined by varying the renormalization, factoriza-tion and resummation scales in the ME by factors 0.5 and 2, together with a change of the merging scalefrom 20 GeV to 15 GeV or 30 GeV.

For top quark pair or single-top production, processes known to NNLO+NNLL [40] or approximateNNLO [81–83], respectively, the cross-section uncertainty is 7%. The modelling uncertainty on tt̄ isdetermined by comparing the nominal NLO+PS sample with an alternative sample generated with Sherpaincluding up to two ME at NLO and four at LO accuracy. The single-top uncertainty is estimated varyingthe renormalization and factorization scales, and by changing the hdamp parameter and the shower tune.An uncertainty on the interference between the Wt and tt̄ production is estimated by comparing thenominal Wt sample, where all doubly resonant NLO Wt diagrams are removed, with a sample where thecross-section contribution from Feynman diagrams containing two top quarks is subtracted [84].

Diboson processes (WW , W Z and Z Z) are calculated at NLO, and a 6% uncertainty on their cross-section, derived with the MCFM program [33, 34], is applied. Their modelling uncertainty is evaluatedanalogously to V+jets by varying the scales used to perform the calculation. For W +γ and Z +γ samples,which are computed at LO, a 20% uncertainty on the cross-section is used, with a further 20% modellinguncertainty assigned, based on the measurement in [85].

The cross-sections for top pair production in association with one or two vector bosons are calculated atNLO and an uncertainty of 15% is used [47]. Their modelling uncertainty is evaluated from variations of

8

Page 9: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

Table 2: The physics objects used for classifying the events, with their corresponding label and minimum pTrequirement.

Object jet b-jet electron muon photon EmissT

Label j b e µ γ EmissT

pT (min) [GeV] 60 60 25 25 50 200

the renormalization and factorization scales, together with a change in the merging scale. For tt̄ + γ, anadditional 12% uncertainty on the normalization is considered, while a uniform 30% uncertainty on themodelling is assigned.

Multijet and γ+jets processes are scaled to data, and no uncertainty on their normalization is applied.For multijets the maximum bin-by-bin difference between the Pythia 8 nominal sample and alternativesamples generated with Sherpa and Herwig++ is considered as an uncertainty on the physics modelling.In addition the envelope of the 100 replica sets of the NNPDF23LO PDF is used. The modelling uncer-tainty on γ+jets is estimated from scale variations with the same methodology as for the V+jets samples.The uncertainty on the γγ+jets modelling is instead taken to be of 30% from parton level comparisons ofsamples with varied scales.

A conservative uncertainty of 20% [49] is used for Higgs production in the gluon fusion, VBF and V Hchannels. An further uncertainty of 20% is assigned for the physics modelling.

For the subdominant triboson (including V + γγ), ttH , 3-top, 4-top and tZ production processes a 50%uncertainty is assigned to the event yields, similarly to [86].

7 Event Classification

The events are subdivided into exclusive classes based on the number and type of objects reconstructedin the event; electrons (e), muons (µ), photons (γ), jets ( j), b-tagged jets (b) and large Emiss

T (EmissT ) † are

considered. The subdivision can be regarded as a classification according to the most important featuresof the events. The pT requirements applied on top of the trigger selection and the labels used for eachobject are summarized in Table 2. The classification includes all possible final state configurations andobject multiplicities, e.g. if a data event with seven reconstructed muons is found it is classified in a “7-muon” event class (7µ). Similarly an event with missing transverse momentum, two muons, one photonand four jets is classified and considered in a corresponding event class denoted Emiss

T 2µ1γ4 j.

To suppress sources of fake EmissT additional requirements are applied on events to be classified in Emiss

Tcategories as follows. The meff variable is defined as the scalar sum of the pT of each reconstructed objectin the event and of the Emiss

T . The ratio of EmissT over meff is required to be greater than 0.2, and the

minimum azimuthal separation between the EmissT direction and the three leading reconstructed jets (if

present) has to be greater than 0.4, otherwise the event is rejected. Events in which the jet closest in φ tothe Emiss

T direction is found in or near an inactive detector region in the hadronic calorimeter barrel arealso discarded.

† Where the EmissT can originate from SM neutrinos or any other weakly interacting neutral particle.

9

Page 10: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

7.1 Corrections to the MC background

The MC samples for multijet and γ+jets production, while giving a good description of kinematic vari-ables, predict an overall cross-section and a jet multiplicity distribution that disagrees with data. In classescontaining only j and b the multijet MC samples are scaled to data with normalization factors derivedseparately in each exclusive jet multiplicity class. For event classes with fewer than 10 events, the nor-malization factor is taken from the event class with one jet (or b-jet) less. For γ+jets final states the samerescaling procedure is applied to channels with exactly one photon, no leptons or Emiss

T , and any numberof jets.

The Sherpa 2.1.1 MC has a known deficiency in the modelling of EmissT due to too large forward jet

activity. This results in a visible mismodelling of the EmissT distribution in event classes with two photons,

which also affects the meff distribution. To correct for this mismodelling a reweighting [87] is applied tothe background from real diphoton events (γγ+jet). The diphoton MC events are reweighted as functionof Emiss

T and of the number of selected jets to match the respective distributions for the inclusive diphotonsample in the range Emiss

T < 100 GeV.

7.2 Classification results

After classification, 639 event classes are found with at least one data event or a SM expectation greaterthan 0.1 events. The data and the background predictions from MC for these classes are shown in Figures1–10. Agreement is observed between data and the prediction in most of the event classes. Event classeswith a large fraction of tt̄ and multiple b-jets show small disagreements with the expectation, consistentwith the findings in Ref. [43]. Data events are found in 470 different event classes. These include eventswith up to four muons, four electrons, three photons, twelve jets and eight b-jets; 17 event classes havea SM expectation of less than 0.1 events. As in none of these classes more than two data events areobserved, they are not considered further in the analysis. The number of classes with a SM expectationlarger than 0.1 events is 622, and these classes are further considered for the statistical analysis.

Final states containing a single object, as well as those containing only EmissT and a lepton are sensitive to

the modelling of the soft particles they recoil against, and are hence discarded from the analysis. In addi-tion final states containing one electron and up to four jets or one b-jet are discarded as the contributionfrom the multijets background with one of the jets faking an electron is important and found to be poorlymodelled by the MC simulation.

8 Statistical Interpretation

In order to quantitatively determine the level of agreement between the data and the SM expectation andto identify regions of possible deviations an algorithm, developed by the H1 Collaboration [1], is used.The algorithm locates the region of largest deviation, be it a deficit or an excess, in a distribution providedin the form of a histogram. In each event class the values of the effective mass and of the total invariantmass in the event are considered. The invariant mass is computed from all visible objects in the event,with no attempt to use the Emiss

T information. These variables have been widely used in searches for newphysics, being sensitive to a large range of new physics signals, manifesting either as bumps or wideexcesses.

10

Page 11: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

2j 3j 4j 5j 6j 7j 8j 9j10

j11

j12

j13

j14

j1b

1j1b

2j1b

3j1b

4j1b

5j1b

6j1b

7j1b

8j1b

9j1b

10j

1b11

j2b

2b1j

2b2j

2b3j

2b4j

2b5j

2b6j

2b7j

2b8j

2b9j 3b

3b1j

3b2j

3b3j

3b4j

3b5j

3b6j

3b7j

3b8j

3b9j 4b

4b1j

4b2j

4b3j

4b4j

4b5j

4b6j 5b

5b1j

5b2j

5b3j

5b4j 6b

6b1j

6b2j

6b3j 7b

8b1j

Eve

nts

1−10

1

10

210

310

410

510

610

710

810Data 2015 3-/4-top Higgs +Z/W/WWtt γ+tt single top

di-/triboson )γ(γZ/W+ +jetstt )+jetsγ(γ Z/W+jets multijets

ATLAS Preliminary-1 = 13 TeV, 3.21 fbs

dijet and multijet

Figure 1: The number of events in data and for the different SM background predictions considered. The classesare labeled according to the multiplicity and type (e, µ, γ, j, b, Emiss

T ) of the reconstructed objects for this eventclass. The hatched bands indicate the total uncertainty of the SM prediction. Part 1 of 12.

1jγ12jγ13jγ14jγ15jγ16jγ17jγ18jγ19jγ1 10j

γ11bγ1 1b1j

γ11b

2jγ11b

3jγ11b

4jγ11b

5jγ11b

6jγ11b

7jγ11b

8jγ1

2bγ1 2b1j

γ12b

2jγ12b

3jγ12b

4jγ12b

5jγ12b

6jγ12b

7jγ1

3bγ1 3b1j

γ13b

2jγ13b

3jγ13b

4jγ1

4bγ1 4b1j

γ14b

2jγ1

γ2 1jγ22jγ23jγ24jγ25jγ26jγ27jγ2

1bγ2 1b1j

γ21b

2jγ21b

3jγ21b

4jγ21b

5jγ2

2bγ2 2b1j

γ22b

2jγ22b

3jγ2

γ3 1jγ3

Eve

nts

1−10

1

10

210

310

410

510

610

710 Data 2015 3-/4-top Higgs +Z/W/WWtt γ+tt single top

di-/triboson )γ(γZ/W+ +jetstt )+jetsγ(γ Z/W+jets multijets

ATLAS Preliminary-1 = 13 TeV, 3.21 fbs

photon(s)

Figure 2: The number of events in data and for the different SM background predictions considered. The classesare labeled according to the multiplicity and type (e, µ, γ, j, b, Emiss

T ) of the reconstructed objects for this eventclass. The hatched bands indicate the total uncertainty of the SM prediction. Part 2 of 12.

11

Page 12: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

1e5j

1e6j

1e7j

1e8j

1e9j

1e1b

4j

1e1b

5j

1e1b

6j

1e1b

7j

1e1b

8j

1e1b

9j

1e2b

1e2b

1j

1e2b

2j

1e2b

3j

1e2b

4j

1e2b

5j

1e2b

6j

1e2b

7j

1e2b

8j

1e3b

1e3b

1j

1e3b

2j

1e3b

3j

1e3b

4j

1e3b

5j

1e3b

6j

1e4b

1e4b

1j

1e4b

2j

1e4b

3j

1e4b

4j

1e4b

5j

1e5b

1e5b

1j

1e5b

2j

Eve

nts

1−10

1

10

210

310

410

510

610 Data 2015 3-/4-top Higgs +Z/W/WWtt γ+tt single top

di-/triboson )γ(γZ/W+ +jetstt )+jetsγ(γ Z/W+jets multijets

ATLAS Preliminary-1 = 13 TeV, 3.21 fbs

single electron

Figure 3: The number of events in data and for the different SM background predictions considered. The classesare labeled according to the multiplicity and type (e, µ, γ, j, b, Emiss

T ) of the reconstructed objects for this eventclass. The hatched bands indicate the total uncertainty of the SM prediction. Part 3 of 12.

1jµ12jµ13jµ14jµ15jµ16jµ17jµ18jµ19jµ1 1bµ1 1b1j

µ11b

2jµ1

1b3j

µ11b

4jµ1

1b5j

µ11b

6jµ1

1b7j

µ11b

8jµ1

1b9j

µ12bµ1 2b1j

µ12b

2jµ1

2b3j

µ12b

4jµ1

2b5j

µ12b

6jµ1

2b7j

µ12b

8jµ1

3bµ1 3b1j

µ13b

2jµ1

3b3j

µ13b

4jµ1

3b5j

µ13b

6jµ1

3b7j

µ14bµ1 4b1j

µ14b

2jµ1

4b3j

µ14b

4jµ1

4b5j

µ15bµ1 5b1j

µ15b

2jµ1

Eve

nts

1−10

1

10

210

310

410

510

610

710Data 2015 3-/4-top Higgs +Z/W/WWtt γ+tt single top

di-/triboson )γ(γZ/W+ +jetstt )+jetsγ(γ Z/W+jets multijets

ATLAS Preliminary-1 = 13 TeV, 3.21 fbs

single muon

Figure 4: The number of events in data and for the different SM background predictions considered. The classesare labeled according to the multiplicity and type (e, µ, γ, j, b, Emiss

T ) of the reconstructed objects for this eventclass. The hatched bands indicate the total uncertainty of the SM prediction. Part 4 of 12.

12

Page 13: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

1eµ1 1e1j

µ1

1e2j

µ1

1e3j

µ1

1e4j

µ1

1e5j

µ1

1e6j

µ1

1e7j

µ1 1e1b

µ1 1e1b

1jµ1

1e1b

2jµ1

1e1b

3jµ1

1e1b

4jµ1

1e1b

5jµ1

1e1b

6jµ1

1e1b

7jµ1

1e2b

µ1 1e2b

1jµ1

1e2b

2jµ1

1e2b

3jµ1

1e2b

4jµ1

1e2b

5jµ1

1e2b

6jµ1

1e3b

µ1 1e3b

1jµ1

1e3b

2jµ1

1e3b

3jµ1

1e3b

4jµ1

1e4b

µ1 1e4b

1jµ1

1e4b

2jµ1

Eve

nts

1−10

1

10

210

310

410

510 Data 2015 3-/4-top Higgs +Z/W/WWtt γ+tt single top

di-/triboson )γ(γZ/W+ +jetstt )+jetsγ(γ Z/W+jets multijets

ATLAS Preliminary-1 = 13 TeV, 3.21 fbs

muon + electron

Figure 5: The number of events in data and for the different SM background predictions considered. The classesare labeled according to the multiplicity and type (e, µ, γ, j, b, Emiss

T ) of the reconstructed objects for this eventclass. The hatched bands indicate the total uncertainty of the SM prediction. Part 5 of 12.

2e2e

1j2e

2j2e

3j2e

4j2e

5j2e

6j2e

7j2e

8j2e

1b2e

1b1j

2e1b

2j2e

1b3j

2e1b

4j2e

1b5j

2e1b

6j2e

1b7j

2e2b

2e2b

1j2e

2b2j

2e2b

3j2e

2b4j

2e2b

5j2e

3b2e

3b1j

2e3b

2j2e

3b3j

2e3b

4j2e

4b2e

4b1j µ2 1jµ22jµ23jµ24jµ25jµ26jµ27jµ28jµ2

1bµ2 1b1j

µ21b

2jµ2

1b3j

µ21b

4jµ2

1b5j

µ21b

6jµ2

1b7j

µ22bµ2 2b1j

µ22b

2jµ2

2b3j

µ22b

4jµ2

2b5j

µ22b

6jµ2

3bµ2 3b1j

µ23b

2jµ2

3b3j

µ24bµ2 4b1j

µ2

Eve

nts

1−10

1

10

210

310

410

510

610

710

810 Data 2015 3-/4-top Higgs +Z/W/WWtt γ+tt single top

di-/triboson )γ(γZ/W+ +jetstt )+jetsγ(γ Z/W+jets multijets

ATLAS Preliminary-1 = 13 TeV, 3.21 fbs

dilepton

Figure 6: The number of events in data and for the different SM background predictions considered. The classesare labeled according to the multiplicity and type (e, µ, γ, j, b, Emiss

T ) of the reconstructed objects for this eventclass. The hatched bands indicate the total uncertainty of the SM prediction. Part 6 of 12.

13

Page 14: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

3e3e

1j3e

2j3e

3j3e

4j3e

1b3e

1b1j

3e1b

2j3e

1b3j

3e2b

3e2b

1j3e

2b2j 2eµ1 2e1j

µ12e

2jµ1

2e3j

µ12e

4jµ1 2e

1bµ1 2e

1b1j

µ12e

1b2j

µ12e

1b3j

µ12e

2bµ1 2e

2b1j

µ12e

2b2j

µ12e

2b5j

µ11eµ2 1e1j

µ21e

2jµ2

1e3j

µ21e

4jµ21e

1bµ2 1e

1b1j

µ21e

1b2j

µ21e

1b3j

µ21e

2bµ2 1e

2b1j

µ21e

2b2j

µ2µ3 1jµ32jµ33jµ34jµ35jµ3

1bµ3 1b1j

µ31b

2jµ3

1b3j

µ31b

4jµ3

2bµ3 2b1j

µ32b

2jµ3

4e4e

1j4e

1b 3eµ12eµ2 2e1j

µ22e

2jµ22e

1bµ2 2e

1b1j

µ21e

2bµ3

µ4 1jµ42jµ4

Eve

nts

1−10

1

10

210

310

410 Data 2015 3-/4-top Higgs +Z/W/WWtt γ+tt single top

di-/triboson )γ(γZ/W+ +jetstt )+jetsγ(γ Z/W+jets multijets

ATLAS Preliminary-1 = 13 TeV, 3.21 fbs

3- and 4-lepton

Figure 7: The number of events in data and for the different SM background predictions considered. The classesare labeled according to the multiplicity and type (e, µ, γ, j, b, Emiss

T ) of the reconstructed objects for this eventclass. The hatched bands indicate the total uncertainty of the SM prediction. Part 7 of 12.

γ1e

1 1jγ1e

12jγ

1e1

3jγ1e

14jγ

1e1

5jγ1e

16jγ

1e1

7jγ1e

1 1bγ1e

1 1b1j

γ1e

11b

2jγ

1e1

1b3j

γ1e

11b

4jγ

1e1

1b5j

γ1e

12bγ

1e1 2b

1jγ

1e1

2b2j

γ1e

12b

3jγ

1e1

2b4j

γ1e

12b

5jγ

1e1

3bγ1e

1 3b1j

γ1e

13b

2jγ

1e1

3b3j

γ1e

1e2 1jγ

1e2

2jγ1e

23jγ

1e2 1b

1jγ

1e2

1b2j

γ1e

2γ1µ11jγ1µ12jγ1µ13jγ1µ14jγ1µ15jγ1µ16jγ1µ1

1bγ1µ11b

1jγ1µ11b

2jγ1µ11b

3jγ1µ11b

4jγ1µ11b

5jγ1µ1

2bγ1µ12b

1jγ1µ12b

2jγ1µ12b

3jγ1µ12b

4jγ1µ12b

5jγ1µ1

3bγ1µ13b

1jγ1µ13b

2jγ1µ1

γ2µ11jγ2µ13jγ2µ1

1b2j

γ2µ1

Eve

nts

1−10

1

10

210

310

410Data 2015 3-/4-top Higgs +Z/W/WWtt γ+tt single top

di-/triboson )γ(γZ/W+ +jetstt )+jetsγ(γ Z/W+jets multijets

ATLAS Preliminary-1 = 13 TeV, 3.21 fbs

single lepton + photon(s)

Figure 8: The number of events in data and for the different SM background predictions considered. The classesare labeled according to the multiplicity and type (e, µ, γ, j, b, Emiss

T ) of the reconstructed objects for this eventclass. The hatched bands indicate the total uncertainty of the SM prediction. Part 8 of 12.

14

Page 15: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

γ2e

1 1jγ2e

1

2jγ2e

1

3jγ2e

1

4jγ2e

1

5jγ2e

1 1bγ2e

1 1b1j

γ2e

1

1b2j

γ2e

1

1b3j

γ2e

1

2bγ2e

1 2b1j

γ2e

1

3bγ2e

1

γ2e

2 γ1e

1µ1

1jγ1e

1µ1

2jγ1e

1µ1

3jγ1e

1µ1

1bγ1e

1µ1

1b1j

γ1e

1µ1

1b2j

γ1e

1µ1

1b3j

γ1e

1µ1

1b4j

γ1e

1µ1

2bγ1e

1µ1

2b1j

γ1e

1µ1

2b2j

γ1e

1µ1

γ1µ2

1jγ1µ2

2jγ1µ2

3jγ1µ2

4jγ1µ2

1bγ1µ2

1b1j

γ1µ2

1b2j

γ1µ2

1b3j

γ1µ2

2bγ1µ2

2b1j

γ1µ2

2b2j

γ1µ2γ2µ2

2jγ2µ2

1jγ1e

1µ2

Eve

nts

1−10

1

10

210

310

410Data 2015 3-/4-top Higgs +Z/W/WWtt γ+tt single top

di-/triboson )γ(γZ/W+ +jetstt )+jetsγ(γ Z/W+jets multijets

ATLAS Preliminary-1 = 13 TeV, 3.21 fbs

multilepton + photon(s)

Figure 9: The number of events in data and for the different SM background predictions considered. The classesare labeled according to the multiplicity and type (e, µ, γ, j, b, Emiss

T ) of the reconstructed objects for this eventclass. The hatched bands indicate the total uncertainty of the SM prediction. Part 9 of 12.

1e1j

mis

sT

E1e

2jm

iss

TE

1e3j

mis

sT

E1e

4jm

iss

TE

1e5j

mis

sT

E1e

6jm

iss

TE

1e7j

mis

sT

E1e

8jm

iss

TE

1e1b

mis

sT

E1e

1b1j

mis

sT

E1e

1b2j

mis

sT

E1e

1b3j

mis

sT

E1e

1b4j

mis

sT

E1e

1b5j

mis

sT

E1e

1b6j

mis

sT

E1e

1b7j

mis

sT

E1e

2bm

iss

TE

1e2b

1jm

iss

TE

1e2b

2jm

iss

TE

1e2b

3jm

iss

TE

1e2b

4jm

iss

TE

1e2b

5jm

iss

TE

1e3b

mis

sT

E1e

3b1j

mis

sT

E1e

3b2j

mis

sT

E1e

3b3j

mis

sT

E1e

3b4j

mis

sT

E1e

4b1j

mis

sT

1e1

mis

sT

E1jγ

1e1

mis

sT

E2jγ

1e1

mis

sT

E3jγ

1e1

mis

sT

E4jγ

1e1

mis

sT

E1bγ

1e1

mis

sT

E1b

1jγ

1e1

mis

sT

E1b

2jγ

1e1

mis

sT

E1b

3jγ

1e1

mis

sT

E2b

2jγ

1e1

mis

sT

E2e

mis

sT

E2e

1jm

iss

TE

2e2j

mis

sT

E2e

3jm

iss

TE

2e4j

mis

sT

E2e

1bm

iss

TE

2e1b

1jm

iss

TE

2e1b

2jm

iss

TE

2e1b

3jm

iss

TE

2e1b

4jm

iss

TE

2e2b

mis

sT

E2e

2b1j

mis

sT

E2e

2b2j

mis

sT

E2e

2b3j

mis

sT

E3e

mis

sT

E3e

1jm

iss

TE

3e2j

mis

sT

E1jµ1

mis

sT

E2jµ1

mis

sT

E3jµ1

mis

sT

E4jµ1

mis

sT

E5jµ1

mis

sT

E6jµ1

mis

sT

E7jµ1

mis

sT

E1bµ1

mis

sT

E1b

1jµ1

mis

sT

E1b

2jµ1

mis

sT

E1b

3jµ1

mis

sT

E1b

4jµ1

mis

sT

E

Eve

nts

1−10

1

10

210

310

410

510

610Data 2015 3-/4-top Higgs +Z/W/WWtt γ+tt single top

di-/triboson )γ(γZ/W+ +jetstt )+jetsγ(γ Z/W+jets multijets

ATLAS Preliminary-1 = 13 TeV, 3.21 fbs

+ (multi-)lepton (1/2)TmissE

Figure 10: The number of events in data and for the different SM background predictions considered. The classesare labeled according to the multiplicity and type (e, µ, γ, j, b, Emiss

T ) of the reconstructed objects for this eventclass. The hatched bands indicate the total uncertainty of the SM prediction. Part 10 of 12.

15

Page 16: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

1b5j

µ1m

iss

TE

1b6j

µ1m

iss

TE

1b7j

µ1m

iss

TE

2bµ1m

iss

TE

2b1j

µ1m

iss

TE

2b2j

µ1m

iss

TE

2b3j

µ1m

iss

TE

2b4j

µ1m

iss

TE

2b5j

µ1m

iss

TE

2b6j

µ1m

iss

TE

3bµ1m

iss

TE

3b1j

µ1m

iss

TE

3b2j

µ1m

iss

TE

3b3j

µ1m

iss

TE

3b4j

µ1m

iss

TE

γ1µ1m

iss

TE

1jγ1µ1m

iss

TE

2jγ1µ1m

iss

TE

3jγ1µ1m

iss

TE

4jγ1µ1m

iss

TE

5jγ1µ1m

iss

TE

1bγ1µ1m

iss

TE

1b1j

γ1µ1m

iss

TE

1b2j

γ1µ1m

iss

TE

1b3j

γ1µ1m

iss

TE

1eµ1m

iss

TE

1e1j

µ1m

iss

TE

1e2j

µ1m

iss

TE

1e3j

µ1m

iss

TE

1e4j

µ1m

iss

TE

1e5j

µ1m

iss

TE

1e1b

µ1m

iss

TE

1e1b

1jµ1

mis

sT

E1e

1b2j

µ1m

iss

TE

1e1b

3jµ1

mis

sT

E1e

1b4j

µ1m

iss

TE

1e2b

µ1m

iss

TE

1e2b

1jµ1

mis

sT

E1e

2b2j

µ1m

iss

TE

1e2b

3jµ1

mis

sT

E1e

2b4j

µ1m

iss

TE

γ1e

1µ1

mis

sT

E1jγ

1e1

µ1m

iss

TE

1bγ1e

1µ1

mis

sT

E2eµ1

mis

sT

E2e

1jµ1

mis

sT

E2e

2jµ1

mis

sT

Eµ2

mis

sT

E1jµ2

mis

sT

E2jµ2

mis

sT

E3jµ2

mis

sT

E4jµ2

mis

sT

E5jµ2

mis

sT

E1bµ2

mis

sT

E1b

1jµ2

mis

sT

E1b

2jµ2

mis

sT

E1b

3jµ2

mis

sT

E1b

4jµ2

mis

sT

E2bµ2

mis

sT

E2b

1jµ2

mis

sT

E2b

2jµ2

mis

sT

E2b

3jµ2

mis

sT

E1eµ2

mis

sT

E1e

1jµ2

mis

sT

E1e

2jµ2

mis

sT

E1jµ3

mis

sT

E2jµ3

mis

sT

E

Eve

nts

1

10

210

310

410Data 2015 3-/4-top Higgs +Z/W/WWtt γ+tt single top

di-/triboson )γ(γZ/W+ +jetstt )+jetsγ(γ Z/W+jets multijets

ATLAS Preliminary-1 = 13 TeV, 3.21 fbs

+ (multi-)lepton (2/2)TmissE

Figure 11: The number of events in data and for the different SM background predictions considered. The classesare labeled according to the multiplicity and type (e, µ, γ, j, b, Emiss

T ) of the reconstructed objects for this eventclass. The hatched bands indicate the total uncertainty of the SM prediction. Part 11 of 12.

1jm

iss

TE

2jm

iss

TE

3jm

iss

TE

4jm

iss

TE

5jm

iss

TE

6jm

iss

TE

7jm

iss

TE

8jm

iss

TE

9jm

iss

TE

1bm

iss

TE

1b1j

mis

sT

E1b

2jm

iss

TE

1b3j

mis

sT

E1b

4jm

iss

TE

1b5j

mis

sT

E1b

6jm

iss

TE

1b7j

mis

sT

E1b

8jm

iss

TE

2bm

iss

TE

2b1j

mis

sT

E2b

2jm

iss

TE

2b3j

mis

sT

E2b

4jm

iss

TE

2b5j

mis

sT

E2b

6jm

iss

TE

3bm

iss

TE

3b1j

mis

sT

E3b

2jm

iss

TE

3b3j

mis

sT

E3b

4jm

iss

TE

3b5j

mis

sT

E4b

mis

sT

E4b

1jm

iss

TE

4b2j

mis

sT

E4b

3jm

iss

TE

γ1m

iss

TE

1jγ1m

iss

TE

2jγ1m

iss

TE

3jγ1m

iss

TE

4jγ1m

iss

TE

5jγ1m

iss

TE

6jγ1m

iss

TE

1bγ1m

iss

TE

1b1j

γ1m

iss

TE

1b2j

γ1m

iss

TE

1b3j

γ1m

iss

TE

1b4j

γ1m

iss

TE

2bγ1m

iss

TE

2b1j

γ1m

iss

TE

2b2j

γ1m

iss

TE

2b3j

γ1m

iss

TE

γ2m

iss

TE

1jγ2m

iss

TE

2jγ2m

iss

TE

1b2j

γ2m

iss

TE

Eve

nts

1−10

1

10

210

310

410

510

610

710

Data 2015 3-/4-top Higgs +Z/W/WWtt γ+tt single top

di-/triboson )γ(γZ/W+ +jetstt )+jetsγ(γ Z/W+jets multijets

ATLAS Preliminary-1 = 13 TeV, 3.21 fbs

+ photons / jetsTmissE

Figure 12: The number of events in data and for the different SM background predictions considered. The classesare labeled according to the multiplicity and type (e, µ, γ, j, b, Emiss

T ) of the reconstructed objects for this eventclass. The hatched bands indicate the total uncertainty of the SM prediction. Part 12 of 12.

16

Page 17: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

The meff and minv distributions input to the scan use a variable bin width with values ranging from 20 GeVto about 2000 GeV. In each event class, the bin widths are determined from the expected resolution ofeach object as function of pT. A given scans starts at the value of the scanned variable greater than twotimes the sum of the minimum pT requirement of each contributing object considered (e.g. 100 GeV fora 2µ class). This avoids sensitivity to the threshold regions. The total number of independent bins with aSM expectation larger than 0.01 events or with data events is 15749.

The number of data events Nobs and the expectation NSM with its total systematic uncertainty δNSM isdetermined for each possible contiguous regions of histogram bins. For each region, a statistical estim-ator is determined from the convolution of the Poisson probability density function (pdf) to account forstatistical errors with a Gaussian pdf, G(x; NSM, δNSM) with mean NSM and width δNSM, to include theeffect of non negligible systematic uncertainties and is defined via:

p0 =

A∫ ∞

0dx G(x; NSM, δNSM)

∞∑i=Nobs

e−x xi

i!Nobs > NSM

A∫ ∞

0dx G(x; NSM, δNSM)

i=Nobs∑i=0

e−x xi

i!+ A∫ 0

−∞

dx G(x; NSM, δNSM) Nobs < NSM

(1)

The factor A ensures that the pdf is normalized to unity. If the Gaussian pdf G is replaced by a Diracdelta function δ(x − NSM) the estimator p0 results in a usual Poisson probability. The value of p0 givesan estimate of the probability for the SM expectation to fluctuate at least as high (or low) as observedin the data in a given region. Here p0 is to be interpreted as a local p0-value. The region of greatestdeviation found by the algorithm is the region with the smallest p0-value. Such a method is able to findnarrow resonances and single outstanding bins as well as signals spread over large regions of phase spacein distributions of any shape. To avoid being sensitive to the effect of poor MC statistics, regions wherethe background prediction has a relative uncertainty of over 100%, are discarded by the algorithm. As aconsequence, a signal that would show up as an excess in data in classes or regions with poor or no MCstatistics would be missed. To avoid overlooking potential excesses it was checked that no region withmore than four data event is discarded by the algorithm.

To illustrate how the algorithm operates, three example distributions are presented. Figure 13a shows theeffective mass distribution for the event class with three b-jets, one jet and Emiss

T (EmissT 3b1 j). Figure 13b

shows the visible invariant mass distribution for the event class with three electrons (3e) and Figure 13cthe visible invariant mass distribution for the class containing one muon, one photon, two b-jets, and twojets (1µ1γ2b2 j). The region of greatest deviation found by the search algorithm in these distributions, anexcess in 13a, deficits in 13b and 13c, is indicated by vertical blue lines.

8.1 Pseudo-experiments generation

The probability that a deviation of a given size occurs somewhere in the event class distributions ismodelled by pseudo-experiments. In this procedure, the data are replaced by pseudo-data which aregenerated according to the SM expectation. Each pseudo-experiment consists of the same event classesand distributions as considered in the data. The search algorithm can then be applied to each of thesedistributions. The p0-value distributions of the pseudo-experiments and their statistical properties can becompared with the p0-value distributions obtained from data.

17

Page 18: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

[GeV]effm900 1000 1100 1200 1300 1400 1500 1600

Eve

nts

1−10

1

10ROI:DATA 5

1.40±BKG 2.18 -VALUE 0.130P

Data 2015 Total SM

+jetstt Z/W+jets

single top +Z/W/WWtt

Higgs di-/triboson

Other

-1 = 13 TeV, 3.21 fbs

3b1jmissTChannel: E

ATLAS Preliminary

[GeV]effm900 1000 1100 1200 1300 1400 1500 1600

Dat

a / M

C

01234

(a)

(all objects) [GeV]invm200 400 600 800 1000 1200

Eve

nts

1−10

1

10

210ROI:DATA 0

2.29±BKG 4.55 -VALUE 0.0820P

Data 2015 Total SM

di-/triboson )γ(γZ/W+

Z/W+jets Other

-1 = 13 TeV, 3.21 fbs

Channel: 3e

ATLAS Preliminary

(all objects) [GeV]invm200 400 600 800 1000 1200

Dat

a / M

C

01234

(b)

(all objects) [GeV]invm1000 1500 2000 2500

Eve

nts

1−10

1

10ROI:DATA 0

0.85±BKG 2.15 -VALUE 0.160P

Data 2015 Total SM

γ+tt +jetstt

)γ(γZ/W+ single top

+Z/W/WWtt Other

-1 = 13 TeV, 3.21 fbs

2b2jγ1µChannel: 1

ATLAS Preliminary

(all objects) [GeV]invm1000 1500 2000 2500

Dat

a / M

C

01234

(c)

Figure 13: Examples distributions showing the results of the scan algorithm. (a) The meff distribution for the eventclass with three b-jets, one jet and large Emiss

T (EmissT 3b1 j). (b) The minv distribution for the event class with three

electrons (3e) and (c) the event class with one muon, one photon, two b-jets and two jets (1µ1γ2b2 j). The hatchedgrey band includes all systematic uncertainties. The dashed vertical blue lines indicate the region of interest, ROI,which has the smallest p0-value returned by the search algorithm.

18

Page 19: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

In generating pseudo-experiments the effect of correlations between bins of the same distribution orbetween distributions of different final states is taken into account. For the experimental uncertaintiesa 100% correlation is assumed for the value of each nuisance parameter. The uncertainty in the normal-ization of the various backgrounds is also considered as 100% correlated across bins and final states. Foruncertainties in the background modelling it has been assumed that there is no correlation, both amongfinal states and within different bins of the same final state. It has been tested that changing the correlationassumptions and the size of the theoretical uncertainties by a factor of two does not lead to an appreciablechange in the results.

Figure 14 shows the fractions of pseudo-experiments that predict at least one, two, or three event classeswith deviations below a given p0-value (pmin) in the scans of the minv and meff distributions. The lowestp0-value in the data is found in the meff distribution of the 1m1e4b2 j event class and amounts to 5 · 10−4.This is consistent at the 70% level with the SM expectation obtained from the pseudo-experiment gen-eration. At least one class with a local p0-value below 10−4 is expected to be found in 30% of thepseudo-experiments in the scans of both the visible invariant mass distributions, and of the effective massdistribution.

)min

(p10

-log0 1 2 3 4 5 6 7 8

Fra

ctio

n of

pse

udo

expe

rimen

ts

0.0

0.2

0.4

0.6

0.8

1.0

σ1 σ2 σ3 σ4 σ5

ATLAS Preliminary-1 = 13 TeV, 3.21 fbs

invvariable: m

pseudo experiments 1 class≥ 2 classes≥ 3 classes≥

Data

pseudo experiments SM-onlyincluding syst. correlations

)min

(p10

-log0 1 2 3 4 5 6 7 8

Fra

ctio

n of

pse

udo

expe

rimen

ts

0.0

0.2

0.4

0.6

0.8

1.0

σ1 σ2 σ3 σ4 σ5

ATLAS Preliminary-1 = 13 TeV, 3.21 fbs

effvariable: m

pseudo experiments 1 class≥ 2 classes≥ 3 classes≥

Data

pseudo experiments SM-onlyincluding syst. correlations

Figure 14: The fraction of pseudo-experiments in which a deviation is found with a p0-value smaller than a givenvalue, − log10(pmin), in the scans of the visible invariant mass, minv (left), and of the effective mass, meff (right). Inblue, green and red, respectively, are shown the expected fractions for observing at least one, two and three eventclasses with deviations above a given − log10(pmin). The coloured arrows represents the largest deviations observedin data.

8.2 Sensitivity to new physics signals

Pseudo-experiments have also been used to test the sensitivity of the analysis to the two benchmark signalmodels (as introduced before). The prediction of a model is added to the SM prediction, and this new totalprediction is used to generate pseudo-data samples. Again a MC technique is used to vary the distributionof signal events and to generate pseudo-experiments. The algorithm is run on the pseudo-experiments asfor real data, and the distribution of local p0-values is derived.

As figure of merit of the analysis’ sensitivity the fraction of pseudo-experiments which predict at least oneevent class below a given p0-value (pmin) is computed, both for the SM and SM plus signal hypotheses. InFigure 15 we show the sensitivity for the two benchmark signals considered as function of the mass of theproduced particle. For the Z ′ model, where we expect to reconstruct the resonance mass from its decay

19

Page 20: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

)min

(p10

-log0 1 2 3 4 5 6 7 8

Fra

ctio

n of

pse

udo

expe

rimen

ts

0.0

0.2

0.4

0.6

0.8

1.0

σ1 σ2 σ3 σ4 σ5

pseudo experiments 1 class≥SM-only,

= 9.54 fbZ'σ = 2 TeV, Z'

SM + Z', m

= 0.816 fbZ'σ = 3 TeV, Z'

SM + Z', m

= 0.00852 fbZ'σ = 4 TeV, Z'

SM + Z', m

ATLASSimulation Preliminary

invvariable: m

)min

(p10

-log0 1 2 3 4 5 6 7 8

Fra

ctio

n of

pse

udo

expe

rimen

ts

0.0

0.2

0.4

0.6

0.8

1.0

σ1 σ2 σ3 σ4 σ5

pseudo experiments 1 class≥SM-only,

= 325 fbg~

σ, 0

1χ∼+t t→ g~SM +

) = (1000,1) GeV1

0χ∼

,mg~

(m

= 85.6 fbg~

σ, 0

1χ∼+t t→ g~SM +

) = (1200,1) GeV1

0χ∼

,mg~

(m

= 25.3 fbg~

σ, 0

1χ∼+t t→ g~SM +

) = (1400,1) GeV1

0χ∼

,mg~

(m

ATLASSimulation Preliminary

effvariable: m

Figure 15: The fraction of pseudo-experiments in which a deviation is found with a p0-value smaller than a givenvalue, − log10(pmin). The distribution is shown for pseudo-experiments generated under the hypothesis of SMbackground, and after injecting signals of Z ′ → ee, µµ (left) or gluino pairs (right) with g → tt̄ χ̃1

0 decays ofvarying masses. The line corresponding to the injection of a Z ′ with a mass of 4 TeV fully overlaps with the lineobtained from SM-only pseudo-experiments due to the small signal cross-section.

products, we inject the signal on the scan of the minv distribution. Gluinos cascade decay to the lightestneutralino which is undetected leading to missing transverse momentum. In gluino pair production due tothe presence of neutralinos in the decay, it is not possible to fully reconstruct the event. The gluino signalis thus injected in the scan of meff , where a broad excess at large values of this quantity is expected.

Exclusion and discovery sensitivity have to be distinguished when the results of the general search arecompared to model-based searches. An exclusion sensitivity at 95% CL in a dedicated search is equivalentto a single class having a p0-value smaller than 0.05. For discovery a deviation with a global p0-valueless than 3 · 10−7 is required.

In the general search pseudo-experiments are used to compute the probability, Pexp, to find a deviationof a given size in any of the 639 classes. We consider any deviation which would lead to Pexp < 1%as interesting, and worth a dedicated investigation. Applying this sensitivity criteria we can read fromFigure 15 how this search is sensitive to a Z ′ with a mass of about 2 TeV or a gluino with a mass of about1 TeV.

9 Conclusions

The data collected by the ATLAS experiment at the LHC during 2015, corresponding to a total of 3.2 fb−1

of pp collisions, have been used to search for deviations from the SM prediction at high transverse mo-mentum by a model-independent approach. Final states containing electrons, muons, photons, jets, b-tagged jets and missing transverse momentum have been scanned for deviations from the SM MonteCarlo prediction in the distributions of the effective mass and the total visible invariant mass of the re-constructed particles. The total number of exclusive final states investigated is 639. The distribution ofthe significances of the largest deviations found in each final state is compared to an expectation obtainedwith pseudo experiments. No significant deviations are found in the data. The largest discrepancy, with alocal p0-value of 5 · 10−4, is expected in about 70% of the pseudo-experiments.

20

Page 21: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

References

[1] A. Aktas et al., H1 Collaboration,A General search for new phenomena in ep scattering at HERA, Phys.Lett. B602 (2004) 14,arXiv: hep-ex/0408044 [hep-ex].

[2] F. D. Aaron et al., H1 Collaboration, A General Search for New Phenomena at HERA,Phys.Lett. B674 (2009) 257, arXiv: 0901.0507 [hep-ex].

[3] B. Abbott et al., D0 Collaboration, Search for new physics in eµX data at DØ using Sherlock: Aquasi model independent search strategy for new physics, Phys. Rev. D62 (2000) 092004,arXiv: hep-ex/0006011 [hep-ex].

[4] V. M. Abazov et al., D0 Collaboration,A Quasi model independent search for new physics at large transverse momentum,Phys. Rev. D64 (2001) 012004, arXiv: hep-ex/0011067 [hep-ex].

[5] B. Abbott et al., D0 Collaboration,A quasi-model-independent search for new high pT physics at DØ,Phys. Rev. Lett. 86 (2001) 3712, arXiv: hep-ex/0011071 [hep-ex].

[6] T. Aaltonen et al., CDF Collaboration,Model-Independent and Quasi-Model-Independent Search for New Physics at CDF,Phys. Rev. D78 (2008) 012002, arXiv: 0712.1311 [hep-ex].

[7] T. Aaltonen et al., CDF Collaboration, Global Search for New Physics with 2.0 fb−1 at CDF,Phys. Rev. D79 (2009) 011101, arXiv: 0809.3781 [hep-ex].

[8] CMS Collaboration, Model Unspecific Search for New Physics in pp Collisions at sqrt(s) = 7 TeV,CMS-PAS-EXO-10-021, 2011, url: http://cdsweb.cern.ch/record/1360173.

[9] ATLAS Collaboration,A general search for new phenomena with the ATLAS detector in pp collisions at

√s = 7 TeV,

ATLAS-CONF-2012-107, 2012, url: https://cds.cern.ch/record/1472686.

[10] ATLAS Collaboration,A general search for new phenomena with the ATLAS detector in pp collisions at

√s = 8 TeV,

ATLAS-CONF-2014-006, 2014, url: https://cds.cern.ch/record/1666536.

[11] ATLAS Collaboration, The ATLAS Experiment at the CERN Large Hadron Collider,JINST 3 (2008) S08003.

[12] ATLAS Collaboration, ATLAS Insertable B-Layer Technical Design Report, (2010),url: http://cds.cern.ch/record/1291633.

[13] ATLAS Collaboration, 2015 start-up trigger menu and initial performance assessment of theATLAS trigger using Run-2 data, ATL-DAQ-PUB-2016-001, 2016,url: https://cds.cern.ch/record/2136007/.

[14] ATLAS Collaboration, The ATLAS Simulation Infrastructure, Eur. Phys. J. C 70 (2010) 823,arXiv: 1005.4568 [hep-ex].

[15] S. Agostinelli et al., GEANT4: A Simulation toolkit, Nucl.Instrum.Meth. A506 (2003) 250.

[16] ATLAS Collaboration,The simulation principle and performance of the ATLAS fast calorimeter simulation FastCaloSim,ATL-PHYS-PUB-2010-013, 2010, url: https://cds.cern.ch/record/1300517.

21

Page 22: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

[17] T. Sjöstrand, S. Mrenna and P. Z. Skands, A Brief Introduction to PYTHIA 8.1,Comput.Phys.Commun. 178 (2008) 852, arXiv: 0710.3820 [hep-ph].

[18] A. Martin et al., Parton distributions for the LHC, Eur.Phys.J. C63 (2009) 189,arXiv: 0901.0002 [hep-ph].

[19] ATLAS Collaboration, Summary of ATLAS Pythia 8 tunes, ATL-PHYS-PUB-2012-003, 2012,url: https://cds.cern.ch/record/1474107.

[20] D. J. Lange, The EvtGen particle decay simulation package,Nucl. Instrum. Meth. A 462 (2001) 152.

[21] ATLAS Collaboration, ATLAS Pythia 8 tunes to 7 TeV data, ATL-PHYS-PUB-2014-021, 2014,url: https://cds.cern.ch/record/1966419.

[22] R. D. Ball et al., Parton distributions with LHC data, Nucl. Phys. B 867 (2013) 244,arXiv: 1207.1303 [hep-ph].

[23] G. Corcella et al., HERWIG 6: An Event generator for hadron emission reactions with interferinggluons (including supersymmetric processes), JHEP 01 (2001) 010, arXiv: 0011363 [hep-ph].

[24] J. Pumplin et al.,New generation of parton distributions with uncertainties from global QCD analysis,JHEP 07 (2002) 012, arXiv: hep-ph/0201195 [hep-ph].

[25] H.-L. Lai et al., New parton distributions for collider physics, Phys. Rev. D 82 (2010) 074024,arXiv: 1007.2241 [hep-ph].

[26] S. Schumann and F. Krauss,A Parton shower algorithm based on Catani-Seymour dipole factorisation, JHEP 03 (2008) 038,arXiv: 0709.1027 [hep-ph].

[27] ATLAS Collaboration, Monte Carlo Generators for the Production of a W or Z/γ∗ Boson inAssociation with Jets at ATLAS in Run 2, ATL-PHYS-PUB-2016-003, 2016,url: https://cds.cern.ch/record/2120133.

[28] T. Gleisberg and S. Höche, Comix, a new matrix element generator, JHEP 12 (2008) 039,arXiv: 0808.3674 [hep-ph].

[29] F. Cascioli, P. Maierhofer and S. Pozzorini, Scattering Amplitudes with Open Loops,Phys. Rev. Lett. 108 (2012) 111601, arXiv: 1111.5206 [hep-ph].

[30] S. Höche et al., QCD matrix elements + parton showers: The NLO case, JHEP 04 (2013) 027,arXiv: 1207.5030 [hep-ph].

[31] R. Gavin et al., FEWZ 2.0: A code for hadronic Z production at next-to-next-to-leading order,Comput. Phys. Commun. 182 (2011) 2388, arXiv: 1011.3540 [hep-ph].

[32] R. Gavin et al., W Physics at the LHC with FEWZ 2.1, Comput. Phys. Commun. 184 (2013) 208,arXiv: 1201.5896 [hep-ph].

[33] J. M. Campbell and R. K. Ellis, An Update on vector boson pair production at hadron colliders,Phys. Rev. D60 (1999) 113006, arXiv: hep-ph/9905386 [hep-ph].

[34] J. M. Campbell, R. K. Ellis and C. Williams, Vector boson pair production at the LHC,JHEP 07 (2011) 018, arXiv: 1105.0020 [hep-ph].

[35] S. Alioli et al., A general framework for implementing NLO calculations in shower Monte Carloprograms: the POWHEG BOX, JHEP 1006 (2010) 043, arXiv: 1002.2581 [hep-ph].

22

Page 23: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

[36] ATLAS Collaboration, Performance of primary vertex reconstruction in proton–proton collisionsat√

s = 7 TeV in the ATLAS experiment, ATLAS-CONF-2010-069, 2010,url: https://cds.cern.ch/record/1281344.

[37] P. Artoisenet et al.,Automatic spin-entangled decays of heavy resonances in Monte Carlo simulations,JHEP 03 (2013) 015, arXiv: 1212.3460 [hep-ph].

[38] T. Sjostrand, S. Mrenna and P. Z. Skands, PYTHIA 6.4 Physics and Manual,JHEP 0605 (2006) 026, arXiv: hep-ph/0603175 [hep-ph].

[39] P. Z. Skands, Tuning Monte Carlo Generators: The Perugia Tunes,Phys. Rev. D 82 (2010) 074018, arXiv: 1005.3457 [hep-ph].

[40] M. Czakon and A. Mitov,Top++: A Program for the Calculation of the Top-Pair Cross-Section at Hadron Colliders,Comput.Phys.Commun. 185 (2014) 2930, arXiv: 1112.5675 [hep-ph].

[41] M. Czakon, D. Heymes and A. Mitov,High-precision differential predictions for top-quark pairs at the LHC,Phys. Rev. Lett. 116 (2016) 082003, arXiv: 1511.00549 [hep-ph].

[42] M. Czakon, D. Heymes and A. Mitov,Dynamical scales for multi-TeV top-pair production at the LHC, (2016),arXiv: 1606.03350 [hep-ph].

[43] ATLAS Collaboration, Search for the Standard Model Higgs boson produced in association withtop quarks and decaying into a bb̄ pair in pp collisions at

√s = 13 TeV with the ATLAS detector,

ATLAS-CONF-2016-080, 2016, url: https://cds.cern.ch/record/2206255.

[44] ATLAS Collaboration, Multi-boson simulation for 13 TeV ATLAS analyses,ATL-PHYS-PUB-2016-002, 2016, url: https://cds.cern.ch/record/2119986.

[45] ATLAS Collaboration, Expected performance of the ATLAS b-tagging algorithms in Run-2,ATL-PHYS-PUB-2015-022, 2015, url: https://cds.cern.ch/record/2037697.

[46] J. Alwall et al., The automated computation of tree-level and next-to-leading order differentialcross sections, and their matching to parton shower simulations, JHEP 07 (2014) 079,arXiv: 1405.0301 [hep-ph].

[47] J. Alwall et al., MadGraph 5 : Going Beyond, JHEP 06 (2011) 128,arXiv: 1106.0522 [hep-ph].

[48] ATLAS Collaboration, Measurement of the Z/γ∗ boson transverse momentum distribution in ppcollisions at

√s = 7 TeV with the ATLAS detector, JHEP 09 (2014) 145,

arXiv: 1406.3660 [hep-ex].

[49] S. Dittmaier et al., Handbook of LHC Higgs Cross Sections: 2. Differential Distributions, (2012),arXiv: 1201.3084 [hep-ph].

[50] D. London and J. L. Rosner, Extra Gauge Bosons in E(6), Phys. Rev. D34 (1986) 1530.

[51] P. Langacker, The Physics of Heavy Z ′ Gauge Bosons, Rev. Mod. Phys. 81 (2009) 1199,arXiv: 0801.1345 [hep-ph].

[52] Yu. A. Golfand and E. P. Likhtman,Extension of the Algebra of Poincare Group Generators and Violation of p Invariance,JETP Lett. 13 (1971) 323, [Pisma Zh. Eksp. Teor. Fiz.13,452(1971)].

23

Page 24: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

[53] D. V. Volkov and V. P. Akulov, Is the Neutrino a Goldstone Particle?,Phys. Lett. B 46 (1973) 109.

[54] J. Wess and B. Zumino, Supergauge Transformations in Four-Dimensions,Nucl. Phys. B 70 (1974) 39.

[55] J. Wess and B. Zumino, Supergauge Invariant Extension of Quantum Electrodynamics,Nucl. Phys. B 78 (1974) 1.

[56] S. Ferrara and B. Zumino, Supergauge Invariant Yang-Mills Theories,Nucl. Phys. B 79 (1974) 413.

[57] A. Salam and J. A. Strathdee, Supersymmetry and Nonabelian Gauges,Phys. Lett. B 51 (1974) 353.

[58] L. Lonnblad and S. Prestel, Matching Tree-Level Matrix Elements with Interleaved Showers,JHEP 03 (2012) 019, arXiv: 1109.4829 [hep-ph].

[59] W. Beenakker et al., Stop production at hadron colliders, Nucl. Phys. B515 (1998) 3,arXiv: hep-ph/9710451 [hep-ph].

[60] W. Beenakker et al., Supersymmetric top and bottom squark production at hadron colliders,JHEP 08 (2010) 098, arXiv: 1006.4771 [hep-ph].

[61] W. Beenakker et al., Squark and gluino hadroproduction, Int. J. Mod. Phys. A 26 (2011) 2637,arXiv: 1105.1110 [hep-ph].

[62] ATLAS Collaboration,Vertex Reconstruction Performance of the ATLAS Detector at

√s = 13 TeV,

ATL-PHYS-PUB-2015-026, 2015, url: https://cds.cern.ch/record/2037717.

[63] ATLAS Collaboration, Electron efficiency measurements with the ATLAS detector using the 2012LHC proton–proton collision data, ATLAS-CONF-2014-032, 2014,url: https://cds.cern.ch/record/1706245.

[64] ATLAS Collaboration, Electron identification measurements in ATLAS using√

s = 13 TeV datawith 50 ns bunch spacing, ATL-PHYS-PUB-2015-041, 2015,url: https://cds.cern.ch/record/2048202.

[65] ATLAS Collaboration, Muon reconstruction performance of the ATLAS detector in proton–protoncollision data at

√s = 13 TeV, Eur. Phys. J. C 76 (2016) 292, arXiv: 1603.05598 [hep-ex].

[66] ATLAS Collaboration, Electron efficiency measurements with the ATLAS detector using the 2015LHC proton–proton collision data, ATLAS-CONF-2016-024, 2016,url: https://cds.cern.ch/record/2157687.

[67] ATLAS Collaboration, Photon identification in 2015 ATLAS data, ATL-PHYS-PUB-2016-014,2016, url: https://cds.cern.ch/record/2203125.

[68] ATLAS Collaboration, Measurement of the photon identification efficiencies with the ATLASdetector using LHC Run-1 data, (2016), arXiv: 1606.01813 [hep-ex].

[69] ATLAS Collaboration,Electron and photon energy calibration with the ATLAS detector using LHC Run 1 data,Eur. Phys. J. C 74 (2014) 3071, arXiv: 1407.5063 [hep-ex].

[70] M. Cacciari, G. P. Salam and G. Soyez, The Anti-k(t) jet clustering algorithm,JHEP 04 (2008) 063, arXiv: 0802.1189 [hep-ph].

24

Page 25: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

[71] ATLAS Collaboration,Topological cell clustering in the ATLAS calorimeters and its performance in LHC Run 1, (2016),arXiv: 1603.02934 [hep-ex].

[72] ATLAS Collaboration, Jet Calibration and Systematic Uncertainties for Jets Reconstructed in theATLAS Detector at

√s = 13 TeV, ATL-PHYS-PUB-2015-015, 2015,

url: https://cds.cern.ch/record/2037613.

[73] ATLAS Collaboration, Monte Carlo Calibration and Combination of In-situ Measurements of JetEnergy Scale, Jet Energy Resolution and Jet Mass in ATLAS, ATLAS-CONF-2015-037, 2015,url: https://cds.cern.ch/record/2044941.

[74] ATLAS Collaboration,Performance of pile-up mitigation techniques for jets in pp collisions with the ATLAS detector,(2015), arXiv: 1510.03823 [hep-ex].

[75] ATLAS Collaboration,Selection of jets produced in 13 TeV proton–proton collisions with the ATLAS detector,ATLAS-CONF-2015-029, 2015, url: https://cds.cern.ch/record/2037702.

[76] ATLAS Collaboration, Performance of b-Jet Identification in the ATLAS Experiment,JINST 11 (2016) P04008, arXiv: 1512.01094 [hep-ex].

[77] ATLAS Collaboration, Performance of missing transverse momentum reconstruction with theATLAS detector in the first proton–proton collisions at

√s = 13 TeV, ATL-PHYS-PUB-2015-027,

2015, url: https://cds.cern.ch/record/2037904.

[78] ATLAS Collaboration, Expected performance of missing transverse momentum reconstruction forthe ATLAS detector at

√s = 13 TeV, ATL-PHYS-PUB-2015-023, 2015,

url: https://cds.cern.ch/record/2037700.

[79] ATLAS Collaboration, Electron and photon energy calibration with the ATLAS detector usingdata collected in 2015 at

√s = 13 TeV, ATL-PHYS-PUB-2016-015, 2016,

url: https://cds.cern.ch/record/2203514.

[80] ATLAS Collaboration, Improved luminosity determination in pp collisions at√

s = 7 TeV usingthe ATLAS detector at the LHC, Eur. Phys. J. C 73 (2013) 2518, arXiv: 1302.4393 [hep-ex].

[81] N. Kidonakis,Two-loop soft anomalous dimensions for single top quark associated production with a W- or H-,Phys. Rev. D82 (2010) 054018, arXiv: 1005.4451 [hep-ph].

[82] N. Kidonakis, NNLL resummation for s-channel single top quark production,Phys. Rev. D81 (2010) 054028, arXiv: 1001.5034 [hep-ph].

[83] N. Kidonakis, Next-to-next-to-leading-order collinear and soft gluon corrections for t-channelsingle top quark production, Phys. Rev. D83 (2011) 091503, arXiv: 1103.2792 [hep-ph].

[84] S. Frixione et al., Single-top hadroproduction in association with a W boson,JHEP 07 (2008) 029, arXiv: 0805.3067 [hep-ph].

[85] ATLAS Collaboration, Measurement of Wγ and Zγ production cross sections in pp collisions at√

s = 7 TeV and limits on anomalous triple gauge couplings with the ATLAS detector,Phys. Lett. B 717 (2012) 49, arXiv: 1205.2531 [hep-ex].

[86] ATLAS Collaboration, Search for supersymmetry at√

s = 13 TeV in final states with jets and twosame-sign leptons or three leptons with the ATLAS detector, Eur. Phys. J. C 76 (2016) 259,arXiv: 1602.09058 [hep-ex].

25

Page 26: A model-independent general search for new phenomena with ... · to a global significance of less than one sigma. ' 2017 CERN for the benefit of the ATLAS Collaboration. Reproduction

[87] ATLAS Collaboration,Search for supersymmetry in a final state containing two photons and missing transversemomentum in

√s = 13 TeV pp collisions at the LHC using the ATLAS detector,

Eur. Phys. J. C 76 (2016) 517, arXiv: 1606.09150 [hep-ex].

Appendix

Figure 16 shows the distribution of the local p0-values observed in data for each event class, comparedto the expectation obtained by generating pseudo-experiments under the SM hypothesis for the minv andmeff scans.

(p-value)10

-log0 1 2 3 4 5 6 7 8

Num

ber

of e

vent

cla

sses

1

10

210

Fra

ctio

n of

pse

udo

expe

rimen

ts

3−10

2−10

1−10

1σ1 σ2 σ3 σ4 σ5

ATLAS Preliminary-1 = 13 TeV, 3.21 fbs

effvariable: m

pseudo experiments Data

pseudo experiments SM-onlyincluding syst. correlations

(p-value)10

-log0 1 2 3 4 5 6 7 8

Num

ber

of e

vent

cla

sses

1

10

210

Fra

ctio

n of

pse

udo

expe

rimen

ts

3−10

2−10

1−10

1σ1 σ2 σ3 σ4 σ5

ATLAS Preliminary-1 = 13 TeV, 3.21 fbs

invvariable: m

pseudo experiments Data

pseudo experiments SM-onlyincluding syst. correlations

Figure 16: The observed and expected distributions for the number of event classes having a given range in− log10(p0−value) in the scans of the visible invariant mass, minv, and of the effective mass, meff distributions.The data (black dots) are shown together with the expected distribution obtained from pseudo-experiments (redfilled area).

26