This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
ben_ehlert [2022/01/10 20:29] behlert |
ben_ehlert [2022/03/01 09:42] (current) behlert |
||
---|---|---|---|
Line 1: | Line 1: | ||
===== Ben's Weekly Updates ===== | ===== Ben's Weekly Updates ===== | ||
+ | |||
+ | ===== February 28th ===== | ||
+ | |||
+ | **R&F audit manuscript** | ||
+ | |||
+ | - [[https:// | ||
+ | - Relevant R&F [[https:// | ||
+ | - Working with Jonathan on interview questions for decision makers | ||
+ | |||
+ | ===== February 14th ===== | ||
+ | |||
+ | **General** | ||
+ | |||
+ | - Fixed access to the secure server | ||
+ | |||
+ | **R&F audit manuscript** | ||
+ | |||
+ | - Sketch outline and ask for feedback | ||
+ | - Go through 10 " | ||
+ | - Determine roughly what would be needed in methods section. Possible paper to follow: [[https:// | ||
+ | - Finding references (empirical and theoretical) that justify the choice of audit [[https:// | ||
+ | - Begin to plan the interview with stakeholders about utility of audit. What questions should we asking? Is there literature that supports what questions to ask? | ||
+ | |||
+ | ===== February 7th ===== | ||
+ | |||
+ | **General** | ||
+ | |||
+ | - Currently working with Jason/IT on getting access to the secure server (not a show stopper) | ||
+ | |||
+ | **R&F audit manuscript** | ||
+ | |||
+ | - Sketch outline and ask for feedback (link soon) | ||
+ | - Determine roughly what would be needed in methods section. Possible paper to follow: [[https:// | ||
+ | - Finding references (empirical and theoretical) that justify the choice of audit [[https:// | ||
+ | - Begin to plan the interview with stakeholders about utility of audit. What questions should we asking? Is there literature that supports what questions to ask? | ||
+ | |||
+ | Outside of research: Busy week with courses this upcoming week! | ||
+ | |||
+ | ===== January 31st ===== | ||
+ | |||
+ | **Completed** | ||
+ | |||
+ | - Submitted abstract for reliability and fairness audit of ACP models (Manuscript due March 31st) | ||
+ | - Finished onboarding: Get access to data section | ||
+ | |||
+ | **TODO** | ||
+ | |||
+ | - Start drafting background information for manuscript | ||
+ | - Meet with team to determine goals and plan for the survey/ | ||
+ | |||
+ | ===== January 24th ===== | ||
+ | |||
+ | **Completed** | ||
+ | |||
+ | - Met with Jonathan and Siyun to get me up to speed on the reliability and fairness audit of Epic EOL | ||
+ | |||
+ | **TODO** | ||
+ | |||
+ | - Start drafting manuscript/ | ||
+ | - Review model card for ACP when ready | ||
+ | - Meet with a couple more members of the lab | ||
+ | - Finish onboarding: Get access to data section | ||
+ | |||
+ | Personal: Childcare isn't happening again this week (covid) so this' | ||
+ | |||
+ | ===== January 18th ===== | ||
+ | |||
+ | **Completed** | ||
+ | |||
+ | - Explored explainability project. Decided that my research question had pretty much been answered so I'll pivot to a new project. Jason pointed out an interesting paper involving what they call concept bottlenecks: | ||
+ | - Finished onboarding: Summary of work streams | ||
+ | |||
+ | **TODO** | ||
+ | |||
+ | - Meet with Jonathan and Siyun to get integrated into the reliability and fairness audit for epic EOL. | ||
+ | - Flesh out research question: What is a good way to perform a reliability and fairness audit of multiple algorithms? | ||
+ | - Finish onboarding: Get access to data section | ||
===== January 10th ===== | ===== January 10th ===== | ||
Line 5: | Line 82: | ||
**Completed** | **Completed** | ||
- | - Explored some potential rotation projects and met with team members | + | |
+ | - (Scotty) Poking at explainability. The hypothesis is that people will make up a story even if there isn't one and explainability in the affirmative is not helpful. Rather, it should be used in the negative. Run an experiment with something along the lines of ask expert to explain model (using SHAP), rebuild model after some permutation to the data (TBD on details), and ask expert to again explain model. | ||
+ | - (Jason) Change CLMBR pretraining objective to masked language modeling and an autoregressive fine-tuning/ | ||
+ | - (Unknown) On potential rotation projects document, there is " | ||
- Started onboarding | - Started onboarding | ||
Line 11: | Line 91: | ||
- Finish onboarding | - Finish onboarding | ||
- | | + | - Write summary of 2 work streams |
+ | - Get access to data section | ||
+ | | ||
+ | - I will start explainability project | ||
+ | - Compile list of literature | ||
+ | - Paragraphs on the hypothesis/ | ||
+ | - Start designing experiment | ||
+ | - Begin finding application area and experts | ||