[ORGA-SEMANTiCS-2020-EU] DH special track review criteria

Fri Dec 20 14:54:12 CET 2019

Dear all!

As announced, please find below a few explanatory comments on the Special Tracks issue:

1) Nature of a Special Track:

As you maybe have seen, the special track topics are listed in all the calls that have been issued, i.a.w. they are part of the scientifuc track, the P&D track as well as the industry track (--> now added to the call).

This means that a special track will be composed of scientific presentations, P&D presentation and industry presentations. Ideally, a special track additionally comes with its own keynote talks or invited speakers.

2) Generally speaking:

It is possible to set up seperate tracks in Easychair for each special track, so that you can manage the review processes independently from the main track.

If you want to have such a seperate track, please drop me a note. The consequence would be that you set up your own reviewing committee and that to comply with the same quality assurance criteria as in the main track, which is:

- at least 3 reviews per paper

- an acceptance rate below 30%

If you do not want a seperate track, then your submissions will be reviewed as part of the main track. This means you do not have to set up a PC yourselves. Instead, authors and reviewers alike will be able to declare topics of interest. Thus we ensure a good match between the paper's topics and the inetrests and expertise of the reviewers.

--> Action Item: Please tell me whether you want a seperate track in easychair. If yes, make sure you have access the necessary experts to set up your own PC.

3)  Streamlining review criteria

Generally speaking, Semantics is defeinitelly closer to applied research than to basic research. Nevertheless, we need to distinguish at least two dimension sof quality: 1) technical / formal quality criteria and 2) domain specific quality criteria.

Technical criteria have already been defined for each call and they should be domain independent (stylesheet compliance, appropriateness, novelty & impact, relation to existing work etc.).

Domain specific criteria by definition might differ, especially w.r.t. the question what counts as appropriate research and what does not. To tackle this problem, I would recommend the following paragraph to be added to the calls:

We especially encourage contributions that illustrate the applicability of the topics mentioned above for industrial purposes and/or illustrate the business relevance of their contribution for specific industries.

--> Action Item: Pls tell me, if this is sufficient or if you want to define you own specific quality criteria. In case you define a more detaiöled list of quality criteria, we just have to make sure that it somehow complies with the other tracks' criteria.

To sum up,

1) a special track is something like a mini conference within the bigger whole.

2) you can have your seperate Easychair instance, but please be aware that you then also need to organize everything yourlsves.

3) if you decide to do things in a seperate manner, we still need to make sure that your quality criteria comply with the conferebces quality criteria. Maybe the paragraph given above could provide a minimal consensus so that domain specific criteria can be taken into accunt adequately.

... I think this will need ome furtzher discussion. Lets put this on the agenda of one of the next meetings.

In the meanwhile I wish you all enjoyable Xmas holidays and a good start into the next decade!! 😊

BR,

tassilo

With kind regards,
Mit freundlichen Grüßen,

Prof. (FH) Dr.  Tassilo    Pellegrini
------------------------------------
Department of Media and Economics
Department Medien und Wirtschaft

St. Pölten University of Applied Sciences /
Fachhochschule St. Pölten GmbH
Matthias Corvinus-Straße 15, A-3100 St. Pölten
T: +43/2742/313 228 - 417, F: +43/2742/313 228 - 409
E: tassilo.pellegrini at fhstp.ac.at
I: www.fhstp.ac.at<http://www.fhstp.ac.at>
----
Handbuch Medienökonomie (Springer Verlag - liquid version)
Krone, Jan/Pellegrini, Tassilo (Hrsg.):
http://link.springer.com/referencework/10.1007/978-3-658-09632-8

FN 146616m, LG St. Pölten, DVR 1028669F

________________________________
From: Orga-semantics-2020 <orga-semantics-2020-bounces at lists.informatik.uni-leipzig.de> on behalf of Pellegrini Tassilo <Tassilo.Pellegrini at fhstp.ac.at>
Sent: Wednesday, December 18, 2019 3:54:23 nachm.
To: Sabrina Kirrane; Alam, Mehwish; Kieseberg Peter; Albert Meroño Peñuela; orga-semantics-2020 at lists.informatik.uni-leipzig.de
Subject: ***SPAM*** Re: [ORGA-SEMANTiCS-2020-EU] DH special track review criteria

Dear all!

Thanks to everybody for engaging in this important discussion. Victor, Thomas and me also talked about this issue in our orga telco yesterday.

Please expect a detailed reply tomorrow.

Thanks a lot & best regards,

Tassilo

With kind regards,
Mit freundlichen Grüßen,

Prof. (FH) Dr.  Tassilo    Pellegrini
------------------------------------
Department of Media and Economics
Department Medien und Wirtschaft

St. Pölten University of Applied Sciences /
Fachhochschule St. Pölten GmbH
Matthias Corvinus-Straße 15, A-3100 St. Pölten
T: +43/2742/313 228 - 417, F: +43/2742/313 228 - 409
E: tassilo.pellegrini at fhstp.ac.at
I: www.fhstp.ac.at<http://www.fhstp.ac.at>
----
Handbuch Medienökonomie (Springer Verlag - liquid version)
Krone, Jan/Pellegrini, Tassilo (Hrsg.):
http://link.springer.com/referencework/10.1007/978-3-658-09632-8

FN 146616m, LG St. Pölten, DVR 1028669F

________________________________
From: Orga-semantics-2020 <orga-semantics-2020-bounces at lists.informatik.uni-leipzig.de> on behalf of Sabrina Kirrane <sabrina.kirrane at wu.ac.at>
Sent: Tuesday, December 17, 2019 3:40:08 nachm.
To: Alam, Mehwish; Kieseberg Peter; Albert Meroño Peñuela; orga-semantics-2020 at lists.informatik.uni-leipzig.de
Subject: Re: [ORGA-SEMANTiCS-2020-EU] DH special track review criteria

Dear all,

We have already provided Tassilo with PC suggestions for the LegalTech
track, however I was wondering if we could possibly have separate
eaychair tracks for the LegalTech, Digital Humanities and Cultural
Heritage, and Blockchain subtopics with their own PCs?

Best Regards,
Sabrina

On 17/12/2019 08:12, Alam, Mehwish wrote:
> Hi all,
>
> Thanks for supporting our point.
>
> Another point that I was also mentioning to Albert yesterday that in the
> call for Industry and use-case track, the special sub-topics are not
> mentioned. Should they be added in this track too? Since the conference
> encourages a collaboration between industry and academic research. I see
> we are also mentioning it in P&D track (as we did last year).
>
> --
> Best
> Mehwish
>
> *Dr. Mehwish Alam*
> Postdoctoral Researcher
> Information Service Engineering
> Phone. +49 7247 808 195
> Fax. +49 7247 808 78195
> FIZ Karlsruhe - Leibniz Institute for Information Infrastructure
> Hermann-von-Helmholtz-Platz 1
> 76344 Eggenstein-Leopoldshafen
> www.fiz-karlsruhe.de<http://www.fiz-karlsruhe.de>
>
> ------------------------------------------------------------------------
> *From:* Orga-semantics-2020
> [orga-semantics-2020-bounces at lists.informatik.uni-leipzig.de] on behalf
> of Kieseberg Peter [Peter.Kieseberg at fhstp.ac.at]
> *Sent:* 17 December 2019 06:53
> *To:* Albert Meroño Peñuela;
> orga-semantics-2020 at lists.informatik.uni-leipzig.de
> *Subject:* Re: [ORGA-SEMANTiCS-2020-EU] DH special track review criteria
>
> Hi,
>
>
>
> I totally agree with this strategy, especially since I am always
> refuting to review work from digital humanities based on the same
> issues: I simply lack the expertise in the field and the knowledge on
> criteria.
>
>
>
> Br. Peter
>
>
>
> *Von:*Orga-semantics-2020
> <orga-semantics-2020-bounces at lists.informatik.uni-leipzig.de> *Im
> Auftrag von *Albert Meroño Peñuela
> *Gesendet:* Montag, 16. Dezember 2019 21:10
> *An:* orga-semantics-2020 at lists.informatik.uni-leipzig.de
> *Betreff:* [ORGA-SEMANTiCS-2020-EU] DH special track review criteria
>
>
>
> Hi all,
>
>
>
> Mehwish and I had a chat today about the reviewing criteria for the
> Digital Humanities and Cultural Heritage subtopic call for SEMANTiCS. We
> expect a number of these submissions to be more "in-use" kind of papers,
> where standard SW tech is just applied to solve a DH problem and proper
> SW contributions are rather implicit. We were a bit concerned that the
> contributions of these papers might be judged of low novelty in the
> research track by reviewers if they only expect a pure contribution to
> the state of the art of SW.
>
>
>
> We're aware that every research paper that makes it to the proceedings
> must meet the same quality criteria. We thought that this shouldn't
> really be an issue and we could mitigate it by adopting the following
> measures:
>
>
>
> - Assign papers of the DH track to appropriate reviewers --this is, to
> PC members we know have research experience in both DH and SW
>
> - Once assigned, let these reviewers know that the reviewing criteria is
> the same for all research submissions, but that DH papers will have an
> inherent more "in-use" and possibly less "research" side to be considered
>
>
>
> What would you think of this strategy? We thought it was worth
> discussing this in the list since the other subtopics might be in a
> similar situation.
>
>
>
> Thanks @Victor for your suggestions
>
> @Tassilo Could Mehwish and I get access in Easychair to the PC member
> list, so we can prepare our reviewer pool?
>
>
>
> Thanks,
>
> Albert (also on behalf of Mehwish as DH co-chairs)
>
>
> ------------------------------------------------------------------------
>
> FIZ Karlsruhe - Leibniz-Institut für Informationsinfrastruktur GmbH.
> Sitz der Gesellschaft: Eggenstein-Leopoldshafen, Amtsgericht Mannheim
> HRB 101892.
> Geschäftsführerin: Sabine Brünger-Weilandt.
> Vorsitzende des Aufsichtsrats: MinDirig'in Dr. Angelika Willms-Herget.
>
> FIZ Karlsruhe ist zertifiziert mit dem Siegel "audit berufundfamilie".
>
> _______________________________________________
> Orga-semantics-2020 mailing list
> Orga-semantics-2020 at lists.informatik.uni-leipzig.de
> http://lists.informatik.uni-leipzig.de/mailman/listinfo/orga-semantics-2020
>

--
Senior Postdoctoral researcher,
Institute for Information Business
Vienna University of Economics and Business
Tel: +43-1-31336-4494
E-mail: sabrina.kirrane [at] wu.ac.at
Homepage: www.sabrinakirrane.com<http://www.sabrinakirrane.com>
_______________________________________________
Orga-semantics-2020 mailing list
Orga-semantics-2020 at lists.informatik.uni-leipzig.de
http://lists.informatik.uni-leipzig.de/mailman/listinfo/orga-semantics-2020
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.informatik.uni-leipzig.de/pipermail/orga-semantics-2020/attachments/20191220/c5097e4b/attachment-0001.html>