How to do applied research in IT?
About Jack Zheng
Faculty of IT at Kennesaw.edu
Applied Research
IT
Research
Research question
Apply Research
Expected outcome
problem
Test
bi star schema
data
power bi star
Research method
How to do applied research in IT?
About Jack Zheng
Faculty of IT at Kennesaw.edu
Applied Research
IT
Research
Research question
Apply Research
Expected outcome
problem
Test
bi star schema
data
power bi star
Research method
Applied Research in IT A brief research guide for IT 7113 and IT 7123 research project (may be used for other IT class as well) Spring 2024 Features • Applied research is research work that is directly relevant to practical problems and solutions. Compared to more rigorous full-scale academic research, it has the following characteristics: • Practical problems (mostly) • Limited literature research (except for conceptual research) • Limited generalizability • Limited originality • Less focus on theories but more focus on principles or best practices • Usually involves first-hand hands-on experiences as an investigation method • Can sometimes be subjective based on personal experience Typical applied research examples • Test and compare different techniques or methods. Set up test cases, comparison metrics, and test environments. Run tests and record results. Example: https://www.sqlbi.com/articles/power-bi-star-schema-or-single-table/ • Analyze and/or develop a solution (or a technology) to address a well described problem (a real case or a hypothetical representative case). Present each solution’s features, pros, and cons. Make a recommendation based on a specific case (if there is one) if there are more solutions. • Research and compare multiple related technologies or tools. Develop a comprehensive comparison framework and use it to conduct the comparison. Lab testing may be part of the comparison. Example: Gartner’s Magic Quadrant Research Reports • Apply a theory or principles to a particular domain/task, and create specific knowledge, process, or improve current process or design. Frame your research: write a research proposal • A research proposal needs to explain the following three things 1. Research question/problem 2. Research method 3. Expected research outcome Research Topic (Area), Problem, and Question • A topic area is a general subject or topic scope. Usually, it is a high-level scope and needs to be further defined. • A problem is more specific and relevant, that needs answers and solutions. • Research question is a form of phrasing the problem. Usually, it is one sentence. • No matter what topic you choose, it's best to formulate your issue/problem into a concise and clear research question. • Research question leads to a research goal, which is a planned and achievable target in the scope of a particular project. • In explaining your research question, you also need to explain in details • The background or the context of this problem. • Why do you pick this topic? Why is this worth research? • Has anyone done anything before? How is what you are doing different from their work? Subject relevance (to IT) • Some past proposals focused on data analysis based on a particular data sets and tried to get insights from the data and analysis. Although the processes and techniques are considered relevant to data analytics, but they are more relevant to their corresponding subject domains rather than IT. • That following example research questions (goals) are not closely relevant to IT (do not have core IT components) • The purpose of this research is to ascertain the effectiveness of mask mandates. • In order for families to achieve the best outcomes after divorce or separation and help policymakers make decisions, it is important that everyone understands what the courts are doing in these cases. • What are the production challenges for EV? How to encourage the public to switch to electric vehicles? • Analyzing the covid-19 data sets to have a better understanding of the virus. Research methods • Research methods are the ways to investigate the problem. Common methods used in applied research include • Conceptual analysis • Literature research: survey and review (with analysis) of publications, including journals, magazines, public opinions, columns, articles, white papers • Develop framework, model, comparison or assessment • Notable example analysis, case study • Apply a theoretical framework to analyze • Empirical analysis • Hands-on experiences testing/comparing tool features, for product/technology/method • Develop a framework for test/comparison • Apply a theoretical framework to analyze • Secondary data analysis • Experiment/testing • People involved • Technology/product/data involved • Tools comparison and assessment, using a checklist or framework • Apply a testing methodology or framework to analyze • Get evidence from other people • Survey • Focus group study • Design and development • Empirical/conceptual development: summary from own experiences/cases • Define a process or a model • Artifact: App development Expected outcome • Expected outcome is the desired answers or solution • Expected outcome should correspond to the research question. • Depending on the question and research methods, expected outcome could be a • Artifact: application prototype, app, website, product • Theoretical or conceptual • Model/framework • A set of guides, principles, or best practices • Process, or a checklist • Comparison matrix • Data • Experiment results • Testing results • Data analysis results and statistical conclusion or proof to hypothetical statements about theories that explains how things work or why things happen • Describe your expected outcome at the high level. You may not have clear details of the final research result (because you have not completed the research), but you should generally know what is expected or desired. Contributions • What is the contribution? • Worth the research? • How is different from other work? • Value of the work? Does it benefit others? • Depending on its contribution level and generalizability, the research may be able to get published as a conference paper, book chapter, magazine article, or even a journal paper. Or it may be expanded to a mater thesis. Example applied research • Power BI – Star schema or single table • https://www.sqlbi.com/articles/power-bi-star-schema-or-single-table/ • What I Learned Recreating One Chart Using 24 Tools • https://source.opennews.org/articles/what-i-learned-recreating-one-chart- using-24-tools/ • The effects of visual embellishment on comprehension and memorability of charts • https://www.researchgate.net/publication/221517808_Useful_Junk_The_effe cts_of_visual_embellishment_on_comprehension_and_memorability_of_cha rts