Reflection 4 - Research Methods

When discussing my research methods, they may change if an effective research plan is not in place. It would help if you had a solid plan to derive the research methods suitable for the study. I begin by utilizing the Learning Design Thinking approach. Initially, I was scattered; I then halted and started brainstorming the research questions I wished to formulate for my argument and determine what case or multiple case analysis would suit the study. I revisited my reflective notes from last week to recall the specific problem or need I am addressing and how it will benefit the educational sector. Several brainstorming questions ran through my mind on institutional effectiveness in helping teachers in higher education and how to use big data with learning analytics to improve their teaching methods. Another question was how effective the institutions are in assisting teachers in higher education to understand how to use data intelligence for best-informed decision-making. Another topic was the effectiveness of institutions in helping higher education professors comprehend how to utilize data intelligence for well-informed decision-making. Is there a difference in the effectiveness of public colleges and Ivy League universities in improving teachers' data literacy and instructional practices?

After brainstorming some of the case studies, I have been reviewing content and context from a theoretical perspective to see what is needed for the study. Since the previous session, I have learned how to proceed with the case research design. Should I extensively concentrate on one case, examine multiple cases, or explore related cases? I must use a mixed-method approach and various strategies to study the sources and work with the secondary data. One excellent concept of the learning design thinking process is that it allows for an iterative approach to the problem and refinement and adaptation as the discovery phase may uncover some unknowns you may have to address differently in the research. In other words, it will allow you to refine the methods, how you review and analyze the data, and what other methods you may need to use to investigate the correlations between each institution's data and its environment. After comprehending the research's scope, you can establish the research approach while considering the theoretical perspective to ensure alignment with the investigation.

I can focus more on the study and findings when I use secondary data to speed up data collection. When comparing universities, the data sets may show tactics, new ideas, gaps, or differences. While the secondary data will help me generate the quantitative analysis, I may need to organize semi-structured interviews for in-depth analysis with instructors on data literacy proficiency, self-efficacy, and challenges they face with professional development in this area. I have yet to define the tool because I am proficient with IBM SPSS but have been learning R Studio. The data procedures I will use to analyze the institution's secondary data will be the reliability analysis utilized Scale and then Reliability analysis options. The Factor Analysis utilized Dimension Reduction and Factor options. I am extracting loadings with principal components and the varimax rotation.

The High-order Analysis will utilize the same procedure above with sub-scales/factors. The Hierarchical Cluster Analysis will utilize the options Classify and then Hierarchical Cluster. The Multi-dimensional used the Scale and the Multi-dimensional scaling ALSCAL option (Euclidean distance, interval measures). Criterion-related validity is used in the Compare Means and Proportions. One-way ANOVA options and the Transform option were created for any sub-scales needed using the Compute Variable option. One of the key factors I will need to understand is the codebook for the secondary data and any derived data cleansing that needs to take place, such as honest responses instead of just replying to all with the same answer or selection. It would be great to get some additional information on working with secondary data in specific techniques in evaluating and using it to meet the needs of the study.