User Tools

Site Tools


ben_ehlert

This is an old revision of the document!


Ben's Weekly Updates

February 7th

General

  1. Currently working with Jason/IT on getting access to the secure server (not a show stopper)

R&F audit manuscript

  1. Sketch outline and ask for feedback (link soon)
  2. Determine roughly what would be needed in methods section. Possible paper to follow: Epic Sepsis model validation
  3. Finding references (empirical and theoretical) that justify the choice of audit starting point
  4. Begin to plan the interview with stakeholders about utility of audit. What questions should we asking? Is there literature that supports what questions to ask?

Outside of research: Busy week with courses this upcoming week!

January 31st

Completed

  1. Submitted abstract for reliability and fairness audit of ACP models (Manuscript due March 31st)
  2. Finished onboarding: Get access to data section

TODO

  1. Start drafting background information for manuscript
  2. Meet with team to determine goals and plan for the survey/interview

January 24th

Completed

  1. Met with Jonathan and Siyun to get me up to speed on the reliability and fairness audit of Epic EOL

TODO

  1. Start drafting manuscript/background information, as part of getting up to speed.
  2. Review model card for ACP when ready
  3. Meet with a couple more members of the lab
  4. Finish onboarding: Get access to data section

Personal: Childcare isn't happening again this week (covid) so this'll be the fourth long week in a row!

January 18th

Completed

  1. Explored explainability project. Decided that my research question had pretty much been answered so I'll pivot to a new project. Jason pointed out an interesting paper involving what they call concept bottlenecks: https://arxiv.org/abs/2007.04612
  2. Finished onboarding: Summary of work streams

TODO

  1. Meet with Jonathan and Siyun to get integrated into the reliability and fairness audit for epic EOL.
  2. Flesh out research question: What is a good way to perform a reliability and fairness audit of multiple algorithms?
  3. Finish onboarding: Get access to data section

January 10th

Completed

  1. Explored some potential rotation projects and met with team members (Jason, Ethan, and Mars). Potential Projects:
    1. (Scotty) Poking at explainability. The hypothesis is that people will make up a story even if there isn't one and explainability in the affirmative is not helpful. Rather, it should be used in the negative. Run an experiment with something along the lines of ask expert to explain model (using SHAP), rebuild model after some permutation to the data (TBD on details), and ask expert to again explain model.
    2. (Jason) Change CLMBR pretraining objective to masked language modeling and an autoregressive fine-tuning/adaption stage.
    3. (Unknown) On potential rotation projects document, there is “predict who does not need a Chest CT (for PE)?” Has this project been worked on? I don't know the clinical workflow for PE, what data would be used before CT?
  2. Started onboarding

TODO

  1. Finish onboarding
    1. Write summary of 2 work streams
    2. Get access to data section
  2. Choose topic area and specific rotation project and jump in!
    1. I will start explainability project
      1. Compile list of literature
      2. Paragraphs on the hypothesis/problem and why it matters
      3. Start designing experiment
      4. Begin finding application area and experts
ben_ehlert.1644935684.txt.gz · Last modified: 2022/02/15 06:34 by behlert