args-framework issueshttps://git.webis.de/code-research/arguana/args/args-framework/-/issues2023-04-21T07:15:44Zhttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/1Abstract from Argument to Result2023-04-21T07:15:44ZJohannes Kieseljohannes.kiesel@uni-weimar.deAbstract from Argument to ResultIn order to allow for the retrieval of other results than arguments, the `Retriever` should retrieve `Result`s. Where `RetrievedArgument` implements `Result`.
Planned model of `Result`:
- Unique ID
- Score
- Type attribute for des...In order to allow for the retrieval of other results than arguments, the `Retriever` should retrieve `Result`s. Where `RetrievedArgument` implements `Result`.
Planned model of `Result`:
- Unique ID
- Score
- Type attribute for deserializationGithub TransitionJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/2Cache result list2019-07-22T16:32:08ZJohannes Kieseljohannes.kiesel@uni-weimar.deCache result listThe retrieved and ranked result list should be cached for faster pagination and general performance increase.The retrieved and ranked result list should be cached for faster pagination and general performance increase.Public releaseJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/3Log queries2019-09-21T23:09:28ZJohannes Kieseljohannes.kiesel@uni-weimar.deLog queriesQueries need to be logged as was done for args v1. A log directory with both the error and query log seems appropriate.
Rotating logs: https://stackoverflow.com/a/21706969Queries need to be logged as was done for args v1. A log directory with both the error and query log seems appropriate.
Rotating logs: https://stackoverflow.com/a/21706969Public releaseJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/4Topic map2019-09-21T22:00:33ZJohannes Kieseljohannes.kiesel@uni-weimar.deTopic mapRequires #19
The topic map needs to be re-implemented. This needs an API endpoint to get the Wiki aspects in large bulks (needs just a different Presenter).
Dora offered help here.
Issues of the previous implementation:
- https://g...Requires #19
The topic map needs to be re-implemented. This needs an API endpoint to get the Wiki aspects in large bulks (needs just a different Presenter).
Dora offered help here.
Issues of the previous implementation:
- https://git.webis.de/webisstud/wstud-argument-search-engine-ss18/issues/2
- https://git.webis.de/webisstud/wstud-argument-search-engine-ss18/issues/3
- https://git.webis.de/webisstud/wstud-argument-search-engine-ss18/issues/4
- searching for a query which returns no results and then switching to Topic Space View allows the user to draw things on the monitor with their mouse https://git.webis.de/webisstud/wstud-argument-search-engine-ss18/raw/master/readmeProblemsImg/imageProblem9.png
- searching for query 'GNU Linux' or 'North American Man Boy Love Association' causes overlap of characters in the Topic Space View visualization. seems to be caused by the implicit '/' character in "GNU/Linux" or "North American Man/Boy Love Association" https://git.webis.de/webisstud/wstud-argument-search-engine-ss18/raw/master/readmeProblemsImg/imageProblem11.png
Public releaseJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/5Counterarguments2020-03-02T10:40:01ZJohannes Kieseljohannes.kiesel@uni-weimar.deCounterargumentsCopied from https://git.webis.de/webisstud/wstud-argument-search-engine-ss18/issues/7
The retrieval of counterarguments, developed in the ACL 2018 paper and then implemented by Philipp Rudloff in his bachelor's thesis, is not integrated...Copied from https://git.webis.de/webisstud/wstud-argument-search-engine-ss18/issues/7
The retrieval of counterarguments, developed in the ACL 2018 paper and then implemented by Philipp Rudloff in his bachelor's thesis, is not integrated yet.
The counterargument candidates should be found offline and indexed, and then displayed in the user interface.Johannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/6Query interpretation: Matching with indexed conclusions2020-03-02T10:44:10ZJohannes Kieseljohannes.kiesel@uni-weimar.deQuery interpretation: Matching with indexed conclusionsCopied from https://git.webis.de/webisstud/wstud-argument-search-engine-ss18/issues/5
The query interpretation based on a matching with indexed conclusions, developed in a student project in Weimar, is not integrated into args.me yet.Copied from https://git.webis.de/webisstud/wstud-argument-search-engine-ss18/issues/5
The query interpretation based on a matching with indexed conclusions, developed in a student project in Weimar, is not integrated into args.me yet.Johannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/7Queries in quotes handled wrongly2023-02-27T08:45:42ZJohannes Kieseljohannes.kiesel@uni-weimar.deQueries in quotes handled wronglyCopied from https://git.webis.de/webisstud/wstud-argument-search-engine-ss18/issues/1
This might already work in the new version, but needs to be tested.
Queries in quotes lead to erroneous results sometimes, maybe even for all queries...Copied from https://git.webis.de/webisstud/wstud-argument-search-engine-ss18/issues/1
This might already work in the new version, but needs to be tested.
Queries in quotes lead to erroneous results sometimes, maybe even for all queries with more than one word (example: "universal health care").
This hasn't been the case always, in particular the examples used in the ArgMining-2017 paper even used quotes. But is already showed up at the end of the initial argument search project.
Probably related (old implementation!):
searching for query '9 11' returns (for now) unexplainable results:
- it shows that there are 0 con-arguments, but 4 con arguments get presented anyways
- every argument but one has '...' as a title, no snippet text and no score, it does show the conclusion though
- could the implicit '/' character in 9/11 be the cause of this problem?
- https://git.webis.de/webisstud/wstud-argument-search-engine-ss18/raw/master/readmeProblemsImg/imageProblem10.pnghttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/8Debate-specific phrases in arguments2020-12-14T11:25:30ZJohannes Kieseljohannes.kiesel@uni-weimar.deDebate-specific phrases in argumentsCopied from https://git.webis.de/webisstud/wstud-argument-search-engine-ss18/issues/10
This might already work in the new version, but needs to be checked.
Many arguments, particularly those from debate.org, contain debate-specific phr...Copied from https://git.webis.de/webisstud/wstud-argument-search-engine-ss18/issues/10
This might already work in the new version, but needs to be checked.
Many arguments, particularly those from debate.org, contain debate-specific phrases that have no meaning for the actual argument. Example: "I forfeit this...".
This should be improved at some point. A perfect solution to this is probably hardly doable, but maybe many easy cases can be tackled with simple heuristics.Johannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/9Troll Forfeits2019-07-16T20:08:16ZJohannes Kieseljohannes.kiesel@uni-weimar.deTroll ForfeitsThis might be solved in the new version, but needs to be checked.
Filter "trolls" forfeiting debates on purpose without any meaningful argument text.
https://git.webis.de/webisstud/wstud-argument-search-engine-ss18/raw/master/readmePro...This might be solved in the new version, but needs to be checked.
Filter "trolls" forfeiting debates on purpose without any meaningful argument text.
https://git.webis.de/webisstud/wstud-argument-search-engine-ss18/raw/master/readmeProblemsImg/imageProblem3.pnghttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/10Debatewise mislabels when no Yes points are shown2019-07-16T09:58:35ZJohannes Kieseljohannes.kiesel@uni-weimar.deDebatewise mislabels when no Yes points are shownThis might be solved in the new version, but needs to be checked
https://debatewise.org/debates/4100-cyber-stalking-has-its-consequences/ "All the Yes Points:"-List is empty, so the "Pro"-Arguments did not get indexed, while the "Con"-A...This might be solved in the new version, but needs to be checked
https://debatewise.org/debates/4100-cyber-stalking-has-its-consequences/ "All the Yes Points:"-List is empty, so the "Pro"-Arguments did not get indexed, while the "Con"-Arguments didhttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/11Debatepedia multiple URLs for same debate2019-07-16T10:00:46ZJohannes Kieseljohannes.kiesel@uni-weimar.deDebatepedia multiple URLs for same debateThis might already be resolved in the new version, but needs to be checked
example: "http://www.debatepedia.org/en/index.php/Debate:_Republika_Srpska_secession_from_Bosnia_and_Herzegovina" and "http://www.debatepedia.org/en/index.php/De...This might already be resolved in the new version, but needs to be checked
example: "http://www.debatepedia.org/en/index.php/Debate:_Republika_Srpska_secession_from_Bosnia_and_Herzegovina" and "http://www.debatepedia.org/en/index.php/Debate:_Republika_Srpska_secession_from_Bosnia"
* Second link-string seems to be cut off at the end to not include the full debate title
* Both links are working! and point to the same debatehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/12Empty argument snippets from Debatepedia2019-07-16T10:01:24ZJohannes Kieseljohannes.kiesel@uni-weimar.deEmpty argument snippets from DebatepediaThis might be fixed in the new version, but needs to be checked.
some argument's snippets from debatepedia only have the title "..." and no snippet-text
https://git.webis.de/webisstud/wstud-argument-search-engine-ss18/raw/master/readme...This might be fixed in the new version, but needs to be checked.
some argument's snippets from debatepedia only have the title "..." and no snippet-text
https://git.webis.de/webisstud/wstud-argument-search-engine-ss18/raw/master/readmeProblemsImg/imageProblem7.pnghttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/13No result when query contains "/"2023-02-27T08:45:32ZJohannes Kieseljohannes.kiesel@uni-weimar.deNo result when query contains "/"This might be resolved in the new framework, but needs to be checked
searching for a query with a '/' character in it will lead to no resultsThis might be resolved in the new framework, but needs to be checked
searching for a query with a '/' character in it will lead to no resultshttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/14Debate.org same discussions with same instigator2020-03-02T10:47:42ZJohannes Kieseljohannes.kiesel@uni-weimar.deDebate.org same discussions with same instigatorSome debaters start the same discussion with other people. This leads to a higher count of the conclusion than appropriate, which can cause problems, for example in #6.
For example suggested conclusion which is long and is very specific...Some debaters start the same discussion with other people. This leads to a higher count of the conclusion than appropriate, which can cause problems, for example in #6.
For example suggested conclusion which is long and is very specific: war game scenario russia versus chosen nation have debates (2-3) from the same debater.https://git.webis.de/code-research/arguana/args/args-framework/-/issues/15Spurious ... arguments2019-07-16T09:50:34ZJohannes Kieseljohannes.kiesel@uni-weimar.deSpurious ... argumentsThis might be fixed in the new version, but needs to be checked.
searching for query 'an economy based on profit-maximizing' returns pages upon pages of arguments with '...' as title
- pro and con columns are also unevenly filled, de...This might be fixed in the new version, but needs to be checked.
searching for query 'an economy based on profit-maximizing' returns pages upon pages of arguments with '...' as title
- pro and con columns are also unevenly filled, despite more pro and con arguments following on the next pages
- incorrect number of con arguments (0) shown in summary
- https://git.webis.de/webisstud/wstud-argument-search-engine-ss18/raw/master/readmeProblemsImg/imageProblem12.pnghttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/16Refactoring into components2020-09-18T21:24:55ZJohannes Kieseljohannes.kiesel@uni-weimar.deRefactoring into componentsRefactoring this repository into repositories:
- args-model (core data structures)
- args-application (implementations of the retrieval pipeline, imports args-model)
- args-api (interface of the server, imports args-model)
- args...Refactoring this repository into repositories:
- args-model (core data structures)
- args-application (implementations of the retrieval pipeline, imports args-model)
- args-api (interface of the server, imports args-model)
- args-server (the actual server, imports args-application, args-api)
- args-client-html (XSL and resources for the HTML client)
This repository (args-framework) should include all above repositories and provide the configuration file to run the server. It serves as the main entry point for documentation.Johannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/17Image search prototype2019-11-09T22:30:46ZJohannes Kieseljohannes.kiesel@uni-weimar.deImage search prototypeBased on query expansion ("good", "bad") and Google images using Selenium:
https://git.webis.de/code-generic/code-kubernetes-hackathon-2019/tree/master/seleniumBased on query expansion ("good", "bad") and Google images using Selenium:
https://git.webis.de/code-generic/code-kubernetes-hackathon-2019/tree/master/seleniumhttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/18API v12019-07-18T12:54:50ZJohannes Kieseljohannes.kiesel@uni-weimar.deAPI v1As XSLT 3.0 allows for JSON output, it should be rather easy to make a presenter that simulates (to a reasonable extend) the old API.As XSLT 3.0 allows for JSON output, it should be rather easy to make a presenter that simulates (to a reasonable extend) the old API.Public releaseJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/19Finalize API v22019-09-20T23:45:12ZJohannes Kieseljohannes.kiesel@uni-weimar.deFinalize API v2Needs a description of the API and some thoughts on whether the endpoints need change.
New parameters of `arguments` endpoint:
- [x] *fields* gives a comma-separated list of the attributes that the result should have (in JSON path syn...Needs a description of the API and some thoughts on whether the endpoints need change.
New parameters of `arguments` endpoint:
- [x] *fields* gives a comma-separated list of the attributes that the result should have (in JSON path syntax, e.g. `fields=id,context.aspects`). All other attributes will not be send. This requires modifications in `Bindings`.
New endpoints:
- [x] single argument at `arguments/<id>`Public releaseJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/20Find a better pro-con view for small displays2019-09-04T07:59:07ZJohannes Kieseljohannes.kiesel@uni-weimar.deFind a better pro-con view for small displaysThe pro-con view currently breaks the columns if the page width is too small, that means the con-column is below the pro-column.
Some "swiping" between left and right seems more appropriate, but unclear how to implement without adding t...The pro-con view currently breaks the columns if the page width is too small, that means the con-column is below the pro-column.
Some "swiping" between left and right seems more appropriate, but unclear how to implement without adding too much complexity.Public releaseJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/21Nicer Empty Results Page2019-08-17T09:49:06ZMartin Potthastmartin.potthast@uni-weimar.deNicer Empty Results PageSee for example: https://args2.webis.de/search.html?query=HP+USB-C
We should show a nicer empty results page, possibly suggesting alternative queries.See for example: https://args2.webis.de/search.html?query=HP+USB-C
We should show a nicer empty results page, possibly suggesting alternative queries.Public releaseJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/22Text Artifacts2019-07-16T20:01:07ZMartin Potthastmartin.potthast@uni-weimar.deText ArtifactsSee https://args2.webis.de/search.html?query=controversial
You will find long dash sequences: -------------------
They should be removed from the data.See https://args2.webis.de/search.html?query=controversial
You will find long dash sequences: -------------------
They should be removed from the data.https://git.webis.de/code-research/arguana/args/args-framework/-/issues/23Pagination: Buttons or Links?2019-09-04T16:00:18ZMartin Potthastmartin.potthast@uni-weimar.dePagination: Buttons or Links?Underlining the numbered links inside the buttons of the pagination selector does not make much sense.
Either buttons, or links.Underlining the numbered links inside the buttons of the pagination selector does not make much sense.
Either buttons, or links.Public releaseJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/24Line break before scores-link2019-08-15T13:43:32ZMartin Potthastmartin.potthast@uni-weimar.deLine break before scores-linkSee https://args2.webis.de/search.html?query=video+surveillance (bottom)
When a URL is too long and breaks to the next line, the scores link unnecessarily break to the next line.See https://args2.webis.de/search.html?query=video+surveillance (bottom)
When a URL is too long and breaks to the next line, the scores link unnecessarily break to the next line.Public releaseJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/25Same title and argument text2019-07-16T20:00:33ZMartin Potthastmartin.potthast@uni-weimar.deSame title and argument textSee: https://args2.webis.de/search.html?query=video%20surveillance&page=3See: https://args2.webis.de/search.html?query=video%20surveillance&page=3https://git.webis.de/code-research/arguana/args/args-framework/-/issues/26Score-Overlay sometimes not visible2019-09-21T23:13:32ZMartin Potthastmartin.potthast@uni-weimar.deScore-Overlay sometimes not visibleWhen the score link is clicked on a search result at the bottom of the browser window, it is shown below instead of above the link.When the score link is clicked on a search result at the bottom of the browser window, it is shown below instead of above the link.https://git.webis.de/code-research/arguana/args/args-framework/-/issues/27Responsiveness: Borders on mobile screens2019-08-15T13:43:28ZMartin Potthastmartin.potthast@uni-weimar.deResponsiveness: Borders on mobile screensWhen viewed in my cellphone, there is no padding to the sides of the screen.When viewed in my cellphone, there is no padding to the sides of the screen.Public releaseJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/28Nonsense arguments2020-04-19T14:01:49ZMartin Potthastmartin.potthast@uni-weimar.deNonsense argumentsSee https://args2.webis.de/search.html?query=test
Those should be removed from the data.See https://args2.webis.de/search.html?query=test
Those should be removed from the data.https://git.webis.de/code-research/arguana/args/args-framework/-/issues/29Larger Logo2019-07-18T12:55:32ZMartin Potthastmartin.potthast@uni-weimar.deLarger LogoIn direct comparison between old and new, we can afford to make the logo a bit larger again, both on the landing page and the search results page.In direct comparison between old and new, we can afford to make the logo a bit larger again, both on the landing page and the search results page.Public releaseJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/30Blacklist query parameters for regular search endpoint2019-07-15T20:56:15ZJohannes Kieseljohannes.kiesel@uni-weimar.deBlacklist query parameters for regular search endpointSome query parameters for the API should not be allowed in the user search. Those should be specified in the configuration fileSome query parameters for the API should not be allowed in the user search. Those should be specified in the configuration filePublic releaseJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/31Debatewise Spam2019-07-16T20:00:21ZJohannes Kieseljohannes.kiesel@uni-weimar.deDebatewise SpamThere are spam arguments in Debatewise like this one:
https://args2.webis.de/search.html?query=cyber+stalking+has+its+consequences
![image](/uploads/23021ea4894269b9a8cba56653a666bb/image.png)
For some reason, the summarizer also fail...There are spam arguments in Debatewise like this one:
https://args2.webis.de/search.html?query=cyber+stalking+has+its+consequences
![image](/uploads/23021ea4894269b9a8cba56653a666bb/image.png)
For some reason, the summarizer also fails here.https://git.webis.de/code-research/arguana/args/args-framework/-/issues/32Reporting problems with arguments2021-03-03T08:14:06ZJohannes Kieseljohannes.kiesel@uni-weimar.deReporting problems with argumentsThere should be an option to allow users of args.me to report back when they see "strange" or "bad" arguments.
Things we might want to be reported:
- Spam arguments: #31, #9
- Not helpful arguments: #25
- Formatting problems: #2...There should be an option to allow users of args.me to report back when they see "strange" or "bad" arguments.
Things we might want to be reported:
- Spam arguments: #31, #9
- Not helpful arguments: #25
- Formatting problems: #22, #8
- Racist/Sexists/... arguments
- ...?
What other services face similar problems? What are their interfaces?
Finding a balance between expressiveness of the labels and simplicity of the reporting interface will be essential.
In a first step, we might just want to collect such reports, review them, and have some functionality to blacklist the arguments if we deem appropriate.
A second step (not part of this issue) would be to automate this process.Johannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/33Highlight the query terms in the snippets2019-08-16T18:20:45ZJohannes Kieseljohannes.kiesel@uni-weimar.deHighlight the query terms in the snippetsThe query terms should be highlighted in the snippets.
Possible options:
- Highlight in retrieval step using generic mark-up and then render accordingly in the presentation step
- Highlight in presentation step using specific techno...The query terms should be highlighted in the snippets.
Possible options:
- Highlight in retrieval step using generic mark-up and then render accordingly in the presentation step
- Highlight in presentation step using specific technology
This is something that probably all presentations can benefit from, so highlighting in the retrieval steps seems more adequate. Introducing another class next to summarizer and stance classifier seems appropriate.Public releaseJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/34Make the initial snippet length configurable2019-07-24T10:58:49ZJohannes Kieseljohannes.kiesel@uni-weimar.deMake the initial snippet length configurableThe initial length of the snippet in the HTML interface should be configurable from the configuration files.The initial length of the snippet in the HTML interface should be configurable from the configuration files.Public releaseJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/35Use colors of the logo2019-07-18T12:46:21ZJohannes Kieseljohannes.kiesel@uni-weimar.deUse colors of the logoThe colors of the original args.me interface should be used.
They are not distinguishable for people suffering from Deuteranopia, but the new interface allows to distinguish between pros and cons without colors.The colors of the original args.me interface should be used.
They are not distinguishable for people suffering from Deuteranopia, but the new interface allows to distinguish between pros and cons without colors.Public releaseJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/36Use DirichletLM for retrieval2021-05-08T07:04:17ZJohannes Kieseljohannes.kiesel@uni-weimar.deUse DirichletLM for retrievalBased on results in https://webis.de/publications.html#filter:Assessing%20Argument%20Relevance
Not sure if we need to go Terrier for that? Anserini might also be an option if we want to stay with Lucene/Elastic (have not checked whether...Based on results in https://webis.de/publications.html#filter:Assessing%20Argument%20Relevance
Not sure if we need to go Terrier for that? Anserini might also be an option if we want to stay with Lucene/Elastic (have not checked whether they support it). I have not used Terrier so far.
Switching out Lucene would be a good test to see how general the framework is ;)
(in theory it should work without much problems...)Alexander BondarenkoAlexander Bondarenkohttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/37API: number of pros and cons2021-02-14T22:18:03ZJohannes Kieseljohannes.kiesel@uni-weimar.deAPI: number of pros and consProvide API to get the total number of pros and cons for a query.
An option would be a parameter-setting for the arguments API that returns no arguments, but causes the internal pipeline to read all.
The result page JSON should include...Provide API to get the total number of pros and cons for a query.
An option would be a parameter-setting for the arguments API that returns no arguments, but causes the internal pipeline to read all.
The result page JSON should include an upper and lower bound of these counts (as well as of the total count), so that the client knows when it is necessary to issue a new request to get this information.Next thingsJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/38Extend the Toolbar2019-09-04T15:07:56ZJohannes Kieseljohannes.kiesel@uni-weimar.deExtend the ToolbarAdd more "tools" than switching the view.
This is really just brain-storming for now.
### Inspiration
![image](/uploads/e6bfcd44e39ac3455ec0db00f4b108e3/image.png)
- Allows just a single selection for each drop-down (Books + Magazi...Add more "tools" than switching the view.
This is really just brain-storming for now.
### Inspiration
![image](/uploads/e6bfcd44e39ac3455ec0db00f4b108e3/image.png)
- Allows just a single selection for each drop-down (Books + Magazines not possible)
- The selected option replaces the text of the drop-down and is rendered bold (if it is not the default). This allows to read the selected options
- A "Clear" "Button" resets all filters
- The date allows to specify a custom range which opens a date picker
![image](/uploads/222051d29c5d29ed4eb28f204f08b7d4/image.png)
- Multi-selection
### Complex design
![image](/uploads/5896df6cf40ac9ff2bddc6089bc19d98/image.png)
Maximum flexibility, but maybe hard to understand. How frequent is a case of "Just facts and images"? Do we really need this? However, for the websites a multi-selections seems plausible.Public releaseJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/39Improve Visual Score Explanation2019-08-15T13:43:02ZJohannes Kieseljohannes.kiesel@uni-weimar.deImprove Visual Score ExplanationThe explanation of the score (more-or-less directly from Lucene) is too complex:
![image](/uploads/030e9a05a8d4d220df04d19e133dec14/image.png)
The previous args version featured a (somewhat) simplified explanation:
![image](/uploads/34...The explanation of the score (more-or-less directly from Lucene) is too complex:
![image](/uploads/030e9a05a8d4d220df04d19e133dec14/image.png)
The previous args version featured a (somewhat) simplified explanation:
![image](/uploads/34e8f5375a63150651ab5a10a8200659/image.png)
One should note that the bottom part contains the MUST conclusion match (boost of 1, not shown) which of course has the same idf and tfNorm values as in the MAY conclusion match above (boost of 0.5). So we could merge them (i.e., boost 1.5) to make things (in my opinion) way simpler.
However, it may be hard to introduce simplifications that still work if we change the retrieval function (or even the framework like in #36). Or if we introduce other argument types (as in #17) which will bring their own retrieval function with them.
But I guess changing the retrieval function is a rare event.Public releaseJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/40Ignored parameters: whitelist instead of blacklist2019-07-24T10:18:21ZJohannes Kieseljohannes.kiesel@uni-weimar.deIgnored parameters: whitelist instead of blacklistWay easier to maintain ;)Way easier to maintain ;)Public releaseJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/41Aspect assessment containment problems2019-09-21T23:11:54ZJohannes Kieseljohannes.kiesel@uni-weimar.deAspect assessment containment problemsAspects are also matched against parts of words.
Stemming might be a good way?Aspects are also matched against parts of words.
Stemming might be a good way?https://git.webis.de/code-research/arguana/args/args-framework/-/issues/42Reduce size of search meta2019-08-15T13:43:24ZJohannes Kieseljohannes.kiesel@uni-weimar.deReduce size of search metaThey are too large (at least for iOS mobile).
Something to keep in mind for #38
![image](/uploads/0c15a90e8d3c6a43b0691e7411c96359/image.png)
![image](/uploads/cb4be6499e05a3087d966d96c1e4a72d/image.png)They are too large (at least for iOS mobile).
Something to keep in mind for #38
![image](/uploads/0c15a90e8d3c6a43b0691e7411c96359/image.png)
![image](/uploads/cb4be6499e05a3087d966d96c1e4a72d/image.png)Public releaseJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/43Reduce footer listing size2019-08-16T18:21:26ZJohannes Kieseljohannes.kiesel@uni-weimar.deReduce footer listing sizeThe left part of the footer is a bit too large from mobile displays to fit into one line. Solutions:
- Reduce space between bullets (just for left -- right is fixed by webis style)
- Remove "Help" (which is a sitemap, but this is har...The left part of the footer is a bit too large from mobile displays to fit into one line. Solutions:
- Reduce space between bullets (just for left -- right is fixed by webis style)
- Remove "Help" (which is a sitemap, but this is hardly needed for a site with ~5 pages total)
![image](/uploads/40f1aa4a234f495a2fa312bd4ac55b24/image.png)https://git.webis.de/code-research/arguana/args/args-framework/-/issues/44Automatically remove annotations that point to non-existing argumentIds2021-01-07T14:51:11ZJohannes Kieseljohannes.kiesel@uni-weimar.deAutomatically remove annotations that point to non-existing argumentIdsA UIMA Annotation type that extends String could be used (clean, but forces the cleanup to happen within the two parts of the assessment step). Or some specific context-name-suffix.
Problem is: this breaks streaming, as the complete lis...A UIMA Annotation type that extends String could be used (clean, but forces the cleanup to happen within the two parts of the assessment step). Or some specific context-name-suffix.
Problem is: this breaks streaming, as the complete list of final arguments is required.
Doing such a step of cleaning might be helpful after both mining and assessment, actually.
Having such dead links in our data is just irritating.https://git.webis.de/code-research/arguana/args/args-framework/-/issues/45Rediscuss argument IDs2019-08-17T09:02:56ZJohannes Kieseljohannes.kiesel@uni-weimar.deRediscuss argument IDsWith arguments recrawling, using the timestamp of acquisition in the idea is not good if we want to provide a page for each argument. This way, links to such pages become dead when we re-index (about once per week?) in the future.
Hashi...With arguments recrawling, using the timestamp of acquisition in the idea is not good if we want to provide a page for each argument. This way, links to such pages become dead when we re-index (about once per week?) in the future.
Hashing the content (premise + conclusion?) might be a better idea (in addition to the URL has). This breaks when arguments get updated. But we could check for arguments that we would loose for any URL and keep them around if we want.Public releaseJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/46RemoteRetrievalPipeline and RemoteHttpRetrievalPipeline2021-01-07T14:51:56ZJohannes Kieseljohannes.kiesel@uni-weimar.deRemoteRetrievalPipeline and RemoteHttpRetrievalPipelineAllow to have the retrieval done on different machines.
Sharding should be possible by creating the query object and using its hash code method.
* [ ] RemoteRetrievalPipeline
* [ ] RemoteHttpRetrievalPipelineAllow to have the retrieval done on different machines.
Sharding should be possible by creating the query object and using its hash code method.
* [ ] RemoteRetrievalPipeline
* [ ] RemoteHttpRetrievalPipelinehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/47Integrate canadian parliament2019-08-15T10:06:22ZJohannes Kieseljohannes.kiesel@uni-weimar.deIntegrate canadian parliamentCode from Visit-the-dome student project.
Only the presentation is missing at the moment.Code from Visit-the-dome student project.
Only the presentation is missing at the moment.https://git.webis.de/code-research/arguana/args/args-framework/-/issues/48Conclusions not displayed in new version2019-08-16T09:39:59ZHenning WachsmuthConclusions not displayed in new versionIn the old version, the full displayed argument text ended with "Supported conclusion: ..." or "Attacked conclusion: ...". This helped interpreting the argument correctly. In the new version, it's not there anymore.
It should be re-incl...In the old version, the full displayed argument text ended with "Supported conclusion: ..." or "Attacked conclusion: ...". This helped interpreting the argument correctly. In the new version, it's not there anymore.
It should be re-included, but better without "conclusion", so: "Supported: ..." and "Attacked: ...".Public releaseJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/49Idebate acquisition: jsoup fails2019-09-10T12:27:35ZJohannes Kieseljohannes.kiesel@uni-weimar.deIdebate acquisition: jsoup failsThe idebate acquisition seems broken:
```
Exception in thread "Thread-9" java.lang.NumberFormatException: For input string: "Terms of Use"
at java.base/java.lang.NumberFormatException.forInputString(NumberFormatException.java:68)
at ja...The idebate acquisition seems broken:
```
Exception in thread "Thread-9" java.lang.NumberFormatException: For input string: "Terms of Use"
at java.base/java.lang.NumberFormatException.forInputString(NumberFormatException.java:68)
at java.base/java.lang.Integer.parseInt(Integer.java:658)
at java.base/java.lang.Integer.parseInt(Integer.java:776)
at me.args.indexing.acquisition.warc.DebateOrgUrlFetcher.getLastPage(DebateOrgUrlFetcher.java:160)
at me.args.indexing.acquisition.warc.DebateOrgUrlFetcher.fetch(DebateOrgUrlFetcher.java:52)
at me.args.indexing.acquisition.warc.CompositeUrlFetcher.lambda$fetch$0(CompositeUrlFetcher.java:112)
at java.base/java.lang.Thread.run(Thread.java:835)
```https://git.webis.de/code-research/arguana/args/args-framework/-/issues/50Aspect space view: large dimension squares overlap with argument points2020-03-02T10:42:23ZJohannes Kieseljohannes.kiesel@uni-weimar.deAspect space view: large dimension squares overlap with argument pointsIf an argument has only one aspect, it is not visible in the aspect space view.If an argument has only one aspect, it is not visible in the aspect space view.Dora KieselDora Kieselhttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/51Aspect space view: on hover on point2020-03-02T10:41:52ZJohannes Kieseljohannes.kiesel@uni-weimar.deAspect space view: on hover on pointOn hovering over a point or after selecting a point, it might be good to illustrate how the point has been positioned:
- As sum of normalized dimension vectors
- As center of weighted polygon
- As center in a spring system with spr...On hovering over a point or after selecting a point, it might be good to illustrate how the point has been positioned:
- As sum of normalized dimension vectors
- As center of weighted polygon
- As center in a spring system with springs attached to dimension squaresDora KieselDora Kieselhttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/52Aspect space view: single point selection2019-10-31T09:20:01ZJohannes Kieseljohannes.kiesel@uni-weimar.deAspect space view: single point selectionI think it is still hard to select a single point by clicking. Increase size of selection radius?I think it is still hard to select a single point by clicking. Increase size of selection radius?Dora KieselDora Kieselhttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/53Aspect space view: loading indicator on argument list2020-03-02T10:42:04ZJohannes Kieseljohannes.kiesel@uni-weimar.deAspect space view: loading indicator on argument listShow a loading indicator upon selection until the result list is updatedShow a loading indicator upon selection until the result list is updatedDora KieselDora Kieselhttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/54Argument page class2021-02-13T21:24:06ZJohannes Kieseljohannes.kiesel@uni-weimar.deArgument page classCreate a class for the argument page to allow for easier extension of the page.Create a class for the argument page to allow for easier extension of the page.Next thingsJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/55Aspect space view on mobile2020-03-02T10:41:22ZJohannes Kieseljohannes.kiesel@uni-weimar.deAspect space view on mobileThe font size should probably be increased on smaller displays. Maybe also other adjustments are needed?The font size should probably be increased on smaller displays. Maybe also other adjustments are needed?Dora KieselDora Kieselhttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/56Aspect space view: select Other2021-04-30T21:41:34ZJohannes Kieseljohannes.kiesel@uni-weimar.deAspect space view: select OtherIt is currently not possible to select "Other".
This is due to technical limitations on the server side: "Other" is not known at indexing time. It would be possible to create a Lucene query that uses all aspects that are in "Other", but...It is currently not possible to select "Other".
This is due to technical limitations on the server side: "Other" is not known at indexing time. It would be possible to create a Lucene query that uses all aspects that are in "Other", but these are too many to fit into the maximum header size for GET queries.
Possible solutions:
- Use a "ranker" that interprets "Other" based on the aspectSpace parameter and filters out arguments. Pro: uses the information attached by the AspectSpaceProjector without the need to add more analysis. Con: very different to how filtering works for all other aspect ranks, thus requires an own API parameter.
- Make the Retriever interpret "Other" based on the aspectSpace parameter and split it into filters for each represented aspect. Pro: Makes "Other" behave as any other aspect from an API-point of view, with the exception that it requires the aspectSpace parameter. Con: probably less effective (but not sure about this), as this adds hundreds of clauses to the Lucene query.
I would prefer the second solution over adding a new API parameter, but that one may not be feasible (needs testing).https://git.webis.de/code-research/arguana/args/args-framework/-/issues/57Aspect space view: multiple selection2020-03-02T10:41:43ZJohannes Kieseljohannes.kiesel@uni-weimar.deAspect space view: multiple selectionIt is probably useful to select multiple aspects.
How should this be done interface-vice?
What does a multiple selection mean?
- Of of the selected has to be top-ranked?
- All of the selected have to be top-ranked? (thus have the s...It is probably useful to select multiple aspects.
How should this be done interface-vice?
What does a multiple selection mean?
- Of of the selected has to be top-ranked?
- All of the selected have to be top-ranked? (thus have the same weight)
- All of the selected have to have a top-n-rank (n being the number of selected aspects)?
The API supports all of these options, though maybe special considerations need to be taken for "Other": #56Dora KieselDora Kieselhttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/58Aspect space view: de-select by clicking outside of space2019-10-31T09:22:42ZJohannes Kieseljohannes.kiesel@uni-weimar.deAspect space view: de-select by clicking outside of spaceIt should be possible to de-select everything (aspects and polygon-selections) by clicking outside the polygon region.
However, clicking on a control element ("show full argument", "score", ...) should not de-select.
Maybe just a click...It should be possible to de-select everything (aspects and polygon-selections) by clicking outside the polygon region.
However, clicking on a control element ("show full argument", "score", ...) should not de-select.
Maybe just a click into the column that contains the aspect space?Dora KieselDora Kieselhttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/59Score not shown properly when the premise is not matched2020-02-19T16:16:40ZJohannes Kieseljohannes.kiesel@uni-weimar.deScore not shown properly when the premise is not matched![image](/uploads/202d52c26c3a4c55c20125c04411ebcc/image.png)![image](/uploads/202d52c26c3a4c55c20125c04411ebcc/image.png)Johannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/60Use Lucene snippets and highlights2020-02-13T21:09:19ZJohannes Kieseljohannes.kiesel@uni-weimar.deUse Lucene snippets and highlightsMake a new ArgumentProcessor that uses Lucene snippet generation and highlighting.
This is a bit weird as the Lucene class that does both directly writes HTML. So we need to parse that HTML and convert the markup into offsets.
Not too ...Make a new ArgumentProcessor that uses Lucene snippet generation and highlighting.
This is a bit weird as the Lucene class that does both directly writes HTML. So we need to parse that HTML and convert the markup into offsets.
Not too difficult -- but will take some time to do and properly test.Johannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/61Decide which filter settings to keep when changing query and mode2020-03-02T10:41:12ZJohannes Kieseljohannes.kiesel@uni-weimar.deDecide which filter settings to keep when changing query and modeThe interface does not know which filter settings will still be available for a new mode or (in case of aspect filters) a new query.
Currently none is kept.
Probably it would be good to keep the mode and respective filter settings when...The interface does not know which filter settings will still be available for a new mode or (in case of aspect filters) a new query.
Currently none is kept.
Probably it would be good to keep the mode and respective filter settings when issuing a new query.https://git.webis.de/code-research/arguana/args/args-framework/-/issues/62Some debatewise arguments seems incomplete2021-03-01T23:23:00ZJohannes Kieseljohannes.kiesel@uni-weimar.deSome debatewise arguments seems incompletehttps://www.args.me/search.html?query=feminism&mode=discussion&sourceDomain=debatewise,idebate,debatepedia
![image](/uploads/501c2a7c4f7b5dabd6c1136f61f9ed38/image.png)
The given source URL does not work, as well.https://www.args.me/search.html?query=feminism&mode=discussion&sourceDomain=debatewise,idebate,debatepedia
![image](/uploads/501c2a7c4f7b5dabd6c1136f61f9ed38/image.png)
The given source URL does not work, as well.https://git.webis.de/code-research/arguana/args/args-framework/-/issues/63Archive all web pages that we crawl2020-05-26T19:32:22ZJohannes Kieseljohannes.kiesel@uni-weimar.deArchive all web pages that we crawlThe Internet Archive allows people to archive web pages. I'm not aware of the details of this process, but it seems we should go for an automatic archiving of the web pages using this service. This will allow us to add a link to the Wayb...The Internet Archive allows people to archive web pages. I'm not aware of the details of this process, but it seems we should go for an automatic archiving of the web pages using this service. This will allow us to add a link to the Wayback Machine to the arguments, which hopefully prevents situations like in #62.https://git.webis.de/code-research/arguana/args/args-framework/-/issues/64Extractive snippet generation2020-08-03T09:33:51ZJohannes Kieseljohannes.kiesel@uni-weimar.deExtractive snippet generationThis should be implemented using premise annotations.
One approach (currently followed by a student in his thesis) is to score each sentence (offline) and use the best for the snippet. This is particularly interesting: should the annota...This should be implemented using premise annotations.
One approach (currently followed by a student in his thesis) is to score each sentence (offline) and use the best for the snippet. This is particularly interesting: should the annotation include the score so that the presenter can decide how much to show? The annotations are then not "snippetness", but something different... importance?Next thingshttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/65Footer update2019-11-09T22:28:49ZJohannes Kieseljohannes.kiesel@uni-weimar.deFooter update- [x] Link to webis impressum
- [x] Update impressum item in footer
- [x] Change spacing between items in footer- [x] Link to webis impressum
- [x] Update impressum item in footer
- [x] Change spacing between items in footerJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/66About update2019-11-09T22:15:14ZJohannes Kieseljohannes.kiesel@uni-weimar.deAbout update- [x] Add names of SS2019 students to README (Yamen)
- [x] Synchronize README and about page, simplifying the latter (Johannes)- [x] Add names of SS2019 students to README (Yamen)
- [x] Synchronize README and about page, simplifying the latter (Johannes)Yamen AjjourYamen Ajjourhttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/67Loading indicators for aspect space2021-02-15T14:38:05ZJohannes Kieseljohannes.kiesel@uni-weimar.deLoading indicators for aspect spaceShow the nonagram at the start with a loading indicator at the center. Then add the dimension names once they are ready. Then add the points and remove the loading indicator.Show the nonagram at the start with a loading indicator at the center. Then add the dimension names once they are ready. Then add the points and remove the loading indicator.Dora KieselDora Kieselhttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/68Make Collection Readers threadsafe2021-01-07T14:52:38ZJohannes Kieseljohannes.kiesel@uni-weimar.deMake Collection Readers threadsafe* [x] [debate](https://git.webis.de/args/args-framework/blob/master/src/main/java/me/args/indexing/mining/debate/UimaDebateReader.java)
* [x] [parliamentary](https://git.webis.de/args/args-framework/blob/master/src/main/java/me/args/inde...* [x] [debate](https://git.webis.de/args/args-framework/blob/master/src/main/java/me/args/indexing/mining/debate/UimaDebateReader.java)
* [x] [parliamentary](https://git.webis.de/args/args-framework/blob/master/src/main/java/me/args/indexing/mining/parliamentary/UimaParliamentaryDebateReader.java)
* [x] [reddit](https://git.webis.de/args/args-framework/blob/master/src/main/java/me/args/indexing/mining/reddit/AbstractUimaRedditReader.java)
* [X] [warc](https://git.webis.de/args/args-framework/blob/master/src/main/java/me/args/indexing/mining/warc/UimaWarcReader.java)Next thingsJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/69Howtos2023-02-27T08:42:12ZJohannes Kieseljohannes.kiesel@uni-weimar.deHowtos* [x] Collect a list of desired howtos in the README
* [ ] Implement them* [x] Collect a list of desired howtos in the README
* [ ] Implement themJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/70API: format HTML does not work2020-09-19T19:27:42ZJohannes Kieseljohannes.kiesel@uni-weimar.deAPI: format HTML does not workAPI returns a server error when format=html is requestedAPI returns a server error when format=html is requestedNext thingsJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/71Move indexing pipeline to Kubernetes2023-04-21T07:15:36ZJohannes Kieseljohannes.kiesel@uni-weimar.deMove indexing pipeline to KubernetesProbably in two parts: acquisition and indexing. Use Kubernetes CronJobs.
The indexing job has to run after the acquisition job. How to do this?
The retrieval container has to reload the index when it is rebuild. How to do this?
How t...Probably in two parts: acquisition and indexing. Use Kubernetes CronJobs.
The indexing job has to run after the acquisition job. How to do this?
The retrieval container has to reload the index when it is rebuild. How to do this?
How to monitor these processesGithub TransitionJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/72Move service to Kubernetes2020-09-18T20:41:35ZJohannes Kieseljohannes.kiesel@uni-weimar.deMove service to KubernetesLoad index from ceph. Write logs to ceph.Load index from ceph. Write logs to ceph.Next thingsJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/73Default for argument endpoint is XML, not JSON2020-09-18T20:41:04ZJohannes Kieseljohannes.kiesel@uni-weimar.deDefault for argument endpoint is XML, not JSONExample:
```
curl https://www.args.me/api/v2/arguments/S9ba8f518-A7b70e679
```Example:
```
curl https://www.args.me/api/v2/arguments/S9ba8f518-A7b70e679
```Next thingsJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/74Add example to API description2020-09-20T21:07:21ZJohannes Kieseljohannes.kiesel@uni-weimar.deAdd example to API descriptionOne simple example and one example of how to convert UI-URL to API-URL.One simple example and one example of how to convert UI-URL to API-URL.Next thingsJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/75Allow to filter by acquisition date2021-03-01T23:08:37ZJohannes Kieseljohannes.kiesel@uni-weimar.deAllow to filter by acquisition dateThis is necessary so that competitions can work on a static corpus by requesting arguments up to a certain point.
This requires that we do not overwrite arguments that were acquired beforehand with a newer acquisition date. So we have t...This is necessary so that competitions can work on a static corpus by requesting arguments up to a certain point.
This requires that we do not overwrite arguments that were acquired beforehand with a newer acquisition date. So we have to go with a "first-accessed" instead of a "last-accessed" policy for that attribute.Next thingsJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/76Get index term statistics2023-02-27T08:41:47ZJohannes Kieseljohannes.kiesel@uni-weimar.deGet index term statisticsOne can get the term statistics of an index in elasticsearch by sending a request like this: "index/_termvectors/id".
A Touche-participant asked for a similar API endpoint for args. This might be something that several API users could ...One can get the term statistics of an index in elasticsearch by sending a request like this: "index/_termvectors/id".
A Touche-participant asked for a similar API endpoint for args. This might be something that several API users could find useful.Github Transitionhttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/77Configure logging2020-08-03T09:34:22ZJohannes Kieseljohannes.kiesel@uni-weimar.deConfigure loggingCurrently logging of some dependencies is not done as it is too verbose.
https://git.webis.de/code-research/arguana/args/args-framework/-/blob/35767d398f0d77799626c1730feef712daf99001/build.gradle#L34
This makes problem if args-framewo...Currently logging of some dependencies is not done as it is too verbose.
https://git.webis.de/code-research/arguana/args/args-framework/-/blob/35767d398f0d77799626c1730feef712daf99001/build.gradle#L34
This makes problem if args-framework is included as a dependency somewhere else.https://git.webis.de/code-research/arguana/args/args-framework/-/issues/78Implement switch for score thresholding for the search API endpoint2020-09-28T19:41:30ZLukas GienappImplement switch for score thresholding for the search API endpointIt would be nice to be able to turn off score thresholding for search endpoint. For some queries, nothing is returned, but sometimes it is desirable to still get the (low)-scored results.It would be nice to be able to turn off score thresholding for search endpoint. For some queries, nothing is returned, but sometimes it is desirable to still get the (low)-scored results.https://git.webis.de/code-research/arguana/args/args-framework/-/issues/79Get a better understanding of how Lucene works2023-02-27T08:41:16ZJohannes Kieseljohannes.kiesel@uni-weimar.deGet a better understanding of how Lucene worksIn order to understand strange things like this one (found by @weho4681):
Es gibt im Index die folgende Conclusion:
Rap Battle: Trump vs Clinton
Wenn ich nach dieser suche, finde ich aber nichts:
https://www.args.me/search.html?query=R...In order to understand strange things like this one (found by @weho4681):
Es gibt im Index die folgende Conclusion:
Rap Battle: Trump vs Clinton
Wenn ich nach dieser suche, finde ich aber nichts:
https://www.args.me/search.html?query=Rap+Battle%3A+Trump+vs+Clinton
Wenn ich den Doppelpunkt weglasse, finde ich Argumente mit der Conclusion:
https://www.args.me/search.html?query=Rap+Battle+Trump+vs+Clinton
Aber jetzt wird's seltsam... Wenn ich die Conclusion mit Doppelpunkt in Anführungszeichen setze, finde ich was:
https://www.args.me/search.html?query=%22Rap+Battle%3A+Trump+vs+Clinton%22https://git.webis.de/code-research/arguana/args/args-framework/-/issues/80idebate links are broken: no https2021-01-07T14:49:54ZMartin Potthastmartin.potthast@uni-weimar.deidebate links are broken: no https![image](/uploads/ad507c16d09e3c36d2b28d8c342cb6fc/image.png)
When clicking on the link, the web page does not load, it works with http as protocol.![image](/uploads/ad507c16d09e3c36d2b28d8c342cb6fc/image.png)
When clicking on the link, the web page does not load, it works with http as protocol.https://git.webis.de/code-research/arguana/args/args-framework/-/issues/81Missing conclusions in full argument2021-03-01T23:13:14ZJohannes Kieseljohannes.kiesel@uni-weimar.deMissing conclusions in full argumentThe conclusions ("Supported: ..." / Attacked: ...") have got lost in the full argument.The conclusions ("Supported: ..." / Attacked: ...") have got lost in the full argument.Next thingsJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/82Argument summary: one sentence at most2020-09-18T20:01:59ZJohannes Kieseljohannes.kiesel@uni-weimar.deArgument summary: one sentence at mostProbably just look for ". ". This could be a boolean option for the summary generator.Probably just look for ". ". This could be a boolean option for the summary generator.https://git.webis.de/code-research/arguana/args/args-framework/-/issues/83Improve contrast of snippet and full argument text2020-09-20T21:15:23ZJohannes Kieseljohannes.kiesel@uni-weimar.deImprove contrast of snippet and full argument textTest different greys. Also discuss with Benno.Test different greys. Also discuss with Benno.Johannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/84Pick the better sentence of the snippet for the summary2020-12-14T11:18:33ZJohannes Kieseljohannes.kiesel@uni-weimar.dePick the better sentence of the snippet for the summaryThe extractive snippet generation approach provides a score for each sentence (the API of @sile2804 does not at the moment). We should pick the higher scored one.
This also needs a small adaption to the ExtractiveSnippet annotation: an ...The extractive snippet generation approach provides a score for each sentence (the API of @sile2804 does not at the moment). We should pick the higher scored one.
This also needs a small adaption to the ExtractiveSnippet annotation: an optional score attribute.Next thingsJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/85Log fallback2020-09-18T20:12:35ZJohannes Kieseljohannes.kiesel@uni-weimar.deLog fallbackLog it (debug level) when a fallback occurs for the different fallback chain composites.Log it (debug level) when a fallback occurs for the different fallback chain composites.https://git.webis.de/code-research/arguana/args/args-framework/-/issues/86Add source attribute to premise annotations2020-09-18T20:05:35ZJohannes Kieseljohannes.kiesel@uni-weimar.deAdd source attribute to premise annotationsTo trace back how the annotations came to be (especially useful for fallback chain composites)To trace back how the annotations came to be (especially useful for fallback chain composites)https://git.webis.de/code-research/arguana/args/args-framework/-/issues/87Arguments from Experts2021-12-14T09:52:26ZJohannes Kieseljohannes.kiesel@uni-weimar.deArguments from ExpertsIntegrate Fan Fan's thesisIntegrate Fan Fan's thesisYamen AjjourYamen Ajjourhttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/88Duplicate IDs for duplicate content2021-02-08T14:28:32ZJohannes Kieseljohannes.kiesel@uni-weimar.deDuplicate IDs for duplicate contentNot sure if this is a problem.
The argument ID is calculated from the URL, the conclusion text, and the premise text.
This means that if an argument is duplicated on the same page and for the same conclusion, they get the same ID, and ...Not sure if this is a problem.
The argument ID is calculated from the URL, the conclusion text, and the premise text.
This means that if an argument is duplicated on the same page and for the same conclusion, they get the same ID, and one of them is thus dropped in indexing.
Now, it seems there are actually several such cases, for example https://www.debate.org/debates/Music-Battle/2/ : there are two posts that just contain the text "http://www.youtube.com... http://www.youtube.com... http://www.youtube.com... http://www.youtube.com... http://www.youtube.com..." (due to debate.org not displaying the full link).
I think it is okay to drop one of these "arguments" since we do not look at links so far. I guess best would probably be to drop both.
So there is nothing to do for this at the moment, so I will close it immediately.https://git.webis.de/code-research/arguana/args/args-framework/-/issues/89Argument Snippet Generator Strange Cases2021-03-19T08:44:08ZJohannes Kieseljohannes.kiesel@uni-weimar.deArgument Snippet Generator Strange CasesPlease update the title once we can pinpoint the problem.
Here is a collection:
- https://dev.args.me/arguments/S47ca84a7-Ad12243ce?query=abortion
Selected "Thank you!" as title. [test.json](/uploads/68e02710ec534eea251d8c0546b4...Please update the title once we can pinpoint the problem.
Here is a collection:
- https://dev.args.me/arguments/S47ca84a7-Ad12243ce?query=abortion
Selected "Thank you!" as title. [test.json](/uploads/68e02710ec534eea251d8c0546b4b778/test.json) [test-single.json](/uploads/28a9c923f1dec813904de52bb18f78e6/test-single.json)
```
$ rid=$(hexdump -n 16 -e '4/4 "%08X" 1 "\n"' /dev/urandom) && curl -X POST "https://snippets.args.me/?id=$rid" --data @test.json -H "Content-type: application/json; charset=UTF-8"
[{"body": [{"span": [2133, 2318], "text": "Even if this speculative mechanism is true, it still would not be classified as an abortifacient because it would not expel fetal membranes or a placenta, as dictated in the definition."}, {"span": [6007, 6045], "text": "This has been a most enjoyable debate."}], "title": {"span": [6007, 6045], "text": "This has been a most enjoyable debate."}}, {"body": [{"span": [741, 778], "text": "It all eliminates the infant correct?"}, {"span": [2415, 2425], "text": "Thank you!"}], "title": {"span": [2415, 2425], "text": "Thank you!"}}, {"body": [{"span": [1872, 1942], "text": "I am against this, I don't believe I can make my argument any simpler."}, {"span": [6031, 6041], "text": "Thank you."}], "title": {"span": [6031, 6041], "text": "Thank you."}}, {"body": [{"span": [954, 1304], "text": "Immoral: -not in conformity with accepted principles of right and wrong behavior -wicked -not in conformity with the accepted standards of proper sexual behavior; unchaste; lewd (may I also note that many compare morality with Christianity as well as many other religious beliefs involving Christ) I care to dispute the fact that abortion is immoral."}, {"span": [3535, 3576], "text": "These also goes for all women in general."}], "title": {"span": [3535, 3576], "text": "These also goes for all women in general."}}, {"body": [{"span": [910, 1009], "text": "I start by arguing that there are many forms of abortion that should be prevented on moral grounds."}, {"span": [2115, 2125], "text": "Thank you."}], "title": {"span": [2115, 2125], "text": "Thank you."}}, {"body": [{"span": [58, 124], "text": "I will state my reasons in the second round in support of my side."}, {"span": [125, 220], "text": "If my opponent would be so kind to state his/her reasons in a brief statement in this round...."}], "title": {"span": [125, 220], "text": "If my opponent would be so kind to state his/her reasons in a brief statement in this round...."}}]
```
The argument in question is the second one, for which the following is returned:
```
{"body": [{"span": [741, 778], "text": "It all eliminates the infant correct?"}, {"span": [2415, 2425], "text": "Thank you!"}], "title": {"span": [2415, 2425], "text": "Thank you!"}}, {"body": [{"span": [1872, 1942], "text": "I am against this, I don't believe I can make my argument any simpler."}, {"span": [6031, 6041], "text": "Thank you."}], "title": {"span": [6031, 6041], "text": "Thank you."}}
```
However, if I send in just the argument, I get a better result:
```
$ rid=$(hexdump -n 16 -e '4/4 "%08X" 1 "\n"' /dev/urandom) && curl -X POST "https://snippets.args.me/?id=$rid" --data @test-single.json -H "Content-type: application/json; charset=UTF-8"
[{"body": [{"span": [63, 227], "text": "\"Whether or not abortion can also be classified as assault is irrelevant to this debate\" (I argue this statement) As a matter of fact it is relevant to this debate."}, {"span": [778, 926], "text": "Therefore, my opponent provided another form of abortion that he stated is the solution to pregnancy even though he is supposed to argue against it."}], "title": {"span": [63, 227], "text": "\"Whether or not abortion can also be classified as assault is irrelevant to this debate\" (I argue this statement) As a matter of fact it is relevant to this debate."}}]
```
- https://dev.args.me/arguments/Sb1869121-A8fd60f2c?query=abortion
No title
- https://dev.args.me/arguments/Sb186fda1-Ab9349bc5?query=abortion
URL as titleMilad AlshomaryMilad Alshomaryhttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/90User Cookie2021-03-06T22:41:51ZJohannes Kieseljohannes.kiesel@uni-weimar.deUser CookieThis is needed to make #32 effective and will be essential for a conversational interface
- A new property for the Query object: `userId` (this is (as wanted) automatically then used in caching)
- A new member for the Query object t...This is needed to make #32 effective and will be essential for a conversational interface
- A new property for the Query object: `userId` (this is (as wanted) automatically then used in caching)
- A new member for the Query object to store cookies
- If not present in the request, an ID String is randomly generated and send to the client through this:
```
Set-Cookie: user=<random>; Domain=args.me; SameSite=Lax
```
This will create a "Session Cookie" that is removed if the browser session ends.
- If present in the request, the Query property will be set and the cookie stored. The stored cookie will be played back to the client on response
- In the future, there will be a page that allows to add `Max-Age=<seconds>` to the cookie, thereby making the cookie last longer than a session. This should also be played back on response (might need adjustments?)
Desirable:
- Is it possible to not create a cookie (unless it exists) when querying the API?Johannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/91Update dataset on Zenodo2023-02-27T08:46:43ZJohannes Kieseljohannes.kiesel@uni-weimar.deUpdate dataset on ZenodoI guess we should wait for #89 but then make a new version on ZenodoI guess we should wait for #89 but then make a new version on ZenodoGithub Transitionhttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/92Show pro/con counts in UI2023-02-27T08:40:17ZJohannes Kieseljohannes.kiesel@uni-weimar.deShow pro/con counts in UIThe API exists now. We should query this API (including `contextId`) by JavaScript on loading a page. The API takes a bit as it has to get all arguments from the index, so we should directly start it and then replace loading indicators i...The API exists now. We should query this API (including `contextId`) by JavaScript on loading a page. The API takes a bit as it has to get all arguments from the index, so we should directly start it and then replace loading indicators in the menu.Github Transitionhttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/93More contrast in snippet highlighting needed2023-02-27T08:40:05ZHenning WachsmuthMore contrast in snippet highlighting neededThe color difference between the snippet sentences and the other sentences in the full argument seem too little now, they are hardly noticeable at all.
Maybe increase contrast between black and gray a bit again?
Notice that should cont...The color difference between the snippet sentences and the other sentences in the full argument seem too little now, they are hardly noticeable at all.
Maybe increase contrast between black and gray a bit again?
Notice that should contrasts may also be clearer on some screens than on others.Johannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/94Use IBM Debater tools2021-03-24T13:59:58ZJohannes Kieseljohannes.kiesel@uni-weimar.deUse IBM Debater tools```
[13:20] Martin Potthast: Can we use some of the IBM
Debater tools to clean up / annotate the args.me
corpus? (also: @Sascha Bondarenko from #touché )
[13:28] Sascha Bondarenko: they provide a bunch of
different classifiers incl...```
[13:20] Martin Potthast: Can we use some of the IBM
Debater tools to clean up / annotate the args.me
corpus? (also: @Sascha Bondarenko from #touché )
[13:28] Sascha Bondarenko: they provide a bunch of
different classifiers including the one for the
argument quality, probably we can
```
@poma1006 @yemi8356
I did not have a look at the API. Still, I expect we can call it during assessment (like [snippet generation](https://git.webis.de/code-research/arguana/args/args-framework/-/blob/master/src/main/java/me/args/indexing/assessment/snippets/TextRankSnippetGenerator.java)). We should again use a [proxy cache](https://git.webis.de/code-generic/code-admin-knowledge-base/-/blob/master/services/args/snippets-args-me.k8s.yaml#L43) to make the repeated assessment of the same argument instantaneous.https://git.webis.de/code-research/arguana/args/args-framework/-/issues/95HTML explanation does not consider just-in-source terms2021-04-08T10:44:53ZJohannes Kieseljohannes.kiesel@uni-weimar.deHTML explanation does not consider just-in-source termsDoes not work:
https://www.args.me/api/v2/arguments?query=Should+Universal+Basic&ids=Sa76b7e0f-Ae9351369&format=html
Works:
https://www.args.me/api/v2/arguments?query=Universal+Basic+Should&ids=Sa76b7e0f-Ae9351369&format=htmlDoes not work:
https://www.args.me/api/v2/arguments?query=Should+Universal+Basic&ids=Sa76b7e0f-Ae9351369&format=html
Works:
https://www.args.me/api/v2/arguments?query=Universal+Basic+Should&ids=Sa76b7e0f-Ae9351369&format=htmlhttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/96Integrate conclugen as an alternative summarizer2021-05-21T09:37:55ZJohannes Kieseljohannes.kiesel@uni-weimar.deIntegrate conclugen as an alternative summarizer@fumi5146 has prepared the docker image. This should get a cache like the snippet generator: https://git.webis.de/code-generic/code-admin-knowledge-base/-/blob/master/services/args/snippets-args-me.k8s.yaml
```
docker run --name=conclug...@fumi5146 has prepared the docker image. This should get a cache like the snippet generator: https://git.webis.de/code-generic/code-admin-knowledge-base/-/blob/master/services/args/snippets-args-me.k8s.yaml
```
docker run --name=conclugen -p 8080:8080 webis/conclugen:combined
```
```
curl -X 'POST' \
'http://localhost:8080/conclude/' \
-H 'accept: application/json' \
-H 'Content-Type: application/json' \
-d '{
"input": "Extremely rich people around rookie who aren’t rich are likely targets, because frankly on a whim that extremely rich person can solve most of the poor persons material problems in an instant. That’s why rich people live in secluded communities so they don’t have to deal with the consequences of obscene wealth."
}'
```
Note to myself: maybe we should just create all summaries for the API (like an array context of `summaries`, each with a `source` and `value` (or similar, have to check for consistency with other things)). And then just select one of these for the web UI.Johannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/97Investigate and prevent ID duplicates2023-02-27T08:39:04ZJohannes Kieseljohannes.kiesel@uni-weimar.deInvestigate and prevent ID duplicatesIt seems there are arguments with the same ID in the dataset.
Some examples:
- Sed086351-A19b607d6
- Se511ec5-A4a6c46b4It seems there are arguments with the same ID in the dataset.
Some examples:
- Sed086351-A19b607d6
- Se511ec5-A4a6c46b4Github TransitionJohannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/98API documentation: context and premise annotations2023-02-27T08:38:41ZJohannes Kieseljohannes.kiesel@uni-weimar.deAPI documentation: context and premise annotationsAdd documentation for the context and premise annotations. Link to papers!Add documentation for the context and premise annotations. Link to papers!Johannes Kieseljohannes.kiesel@uni-weimar.deJohannes Kieseljohannes.kiesel@uni-weimar.dehttps://git.webis.de/code-research/arguana/args/args-framework/-/issues/99Annotate Quotations2023-02-27T08:38:20ZJohannes Kieseljohannes.kiesel@uni-weimar.deAnnotate QuotationsUse quotations markers, text reuse within a page, and HTML.Use quotations markers, text reuse within a page, and HTML.https://git.webis.de/code-research/arguana/args/args-framework/-/issues/100Add git hash to build in shadowjar2023-02-27T08:37:46ZJohannes Kieseljohannes.kiesel@uni-weimar.deAdd git hash to build in shadowjarThis could allow us to have the API documentation link to the respective version in our gitlab.This could allow us to have the API documentation link to the respective version in our gitlab.Github Transition