From: "Ibarra Medel, Hector Javier" Subject: Re: [sloan-25mlog 5512] 2.5m obslog 20210506 (SJD 59341) Date: Fri, 7 May 2021 23:22:33 +0000 --_000_DM6PR11MB29241AF40AA52722FD97F747B5579DM6PR11MB2924namp_ Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable Hi, I take a look at the final reductions, some spectra have a catastrophic= reduction just at 6000-8000 AA (https://data.sdss5.org/sas/sdsswork/bhm/bo= ss/spectro/redux/images/master/master/15173-59341/spec-image-15173-59341-04= 351094424.png), but for other spectra, the reductions look fine (https://da= ta.sdss5.org/sas/sdsswork/bhm/boss/spectro/redux/images/master/master/15173= -59341/spec-image-15173-59341-04350970055.png). I could let the pipeline au= tomatically flag those spectra (for the most of the bad spectra the pipelin= e flag them with "negative_emision" flag) . Yue, that it is ok for the RM? = The other option is discard all the bad exposures (or all the plate) leavin= g only 15-minutes for thise mjd. Hector Ibarra ________________________________ From: Ibarra Medel, Hector Javier Sent: Friday, May 7, 2021 3:38 PM To: Kaike Pan ; Jonathan Trump Cc: obs-report-25m@apo.nmsu.edu ; sdss_local@a= po.nmsu.edu ; Shen, Yue Subject: Re: [sloan-25mlog 5512] 2.5m obslog 20210506 (SJD 59341) Thanks Kaike, it appears that this issue impacts on the plate 15173-59341 t= hat is an RM plate, the full reductions are almost finished and we can insp= ect how this issue impacts in the final reductions. " In other words, you may want to consider to declare all BOSS science data= (except for the first frame, 330704) from last night as bad data." This make usable only one 15 minute exposure from the 6 taken for that spe= cific plate. My proposed solution is to flag those spectra or dependig on h= ow bad the final reductions looks, completly discard these exposures. Many thanks Hector Ibarra ________________________________ From: Kaike Pan Sent: Friday, May 7, 2021 3:00 PM To: Ibarra Medel, Hector Javier ; Jonathan Trump Cc: obs-report-25m@apo.nmsu.edu ; sdss_local@a= po.nmsu.edu Subject: Re: [sloan-25mlog 5512] 2.5m obslog 20210506 (SJD 59341) Hello All, Thanks to Dan and Katie who take some bias, dark, and a set of flat and a= rc. After 10 darks and one dark, impacts of the issue was greatly reduced. However, I still see so= me sign of the impact (see attached image for exposure 330732). Hector and Jon: I checked the data took last night, I see impacts of the el= ectronic issue except for the first science exposure, 330704. In other words, you may want to consider to decla= re all BOSS science data (except for the first frame, 330704) from last night as bad data. I took a set of flat and arc today, the data looks good. One had the issue = last year, and it fixed itself. It=92s good thing is that it works since then, but the bad thing is that we don=92t understan= d what cause it and have no procedure on how to fix the issue. Thanks, -Kaike On May 7, 2021, at 5:38 AM, Daniel Oravetz > wrote: FYI, the biases taken during the morning cals sequence look good and the SOS 98th percentile stats are normal, too. Screenshot attached. Dan and Katie Attached are screenshots of an arc and flat taken on cartridge 8 that shows the electronics shift SOS warned about. APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Thursday May 06, 2021 (SJD 59341) ---- Observing Team ---- Dan Oravetz Katie Grabowski ---- Observing Plan ---- Thu 06 May 2021 59341 0.18 03:04 10:55 11:01 18:53 --- KP BHM ( 7.8 h) ---- Observing Summary ---- Lost 4.7 hours of BHM due to weather. dust=3D22k Unusual SOS warning for both cartridges 4 and 8. Listed in Problems section. Cart.4, plate 15173, RM_SDSS-RM, GSOGTF, 12xA+6xB, not done Missing fibers: [20, 39, 151, 168, 186, 193, 211, 241, 273, 278] Faint fibers: ['121 - 129', '133 - 136', '140 - 141', '147 - 148', '152 - 156', '158 - 164', '166 - 167', '169 - 170', 172, 175, '177 - 180'] ----------------- Cart.8, plate 15308, AQM_246.49_+43.80, GSOGTF, 8xA+4xB, not done Missing fibers: [35, 184, 211, 273] Faint fibers: ['121 - 180'] ----------------- ---- Observing Log ---- Afternoon: =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D All systems alive and responsive. 23:44Z- Started APOGEE cals 23:44:28 boss exposure 0.0, file=3D330694 23:45:47 boss exposure 20.0, file=3D330695 23:48:17 boss exposure 4.0, file=3D330696 23:49:27 boss exposure 4.0, file=3D330697 23:50:51 sp1.motor.move=3D 1482, 1483, 1483 23:50:51 Hartmann collimate output on cart #2 sp1: offset: r=3D 329 (In Focus); b=3D -8.3 (Out of focus) sp1: pred. move: spAverageMove=3D 1482 sp1: pred. resid: r=3D -1153, b=3D -3.6, txt=3D OK, spTemp =3D 9.1 Did not adjust blue rings. 23:57:37 boss exposure 25.0, file=3D330698 00:00:25 boss exposure 4.0, file=3D330699 00:25Z- Started ventilation. Night: =3D=3D=3D=3D=3D=3D Radar and clouds kept us closed. Radar dissipating and sky clearing. 07:30:34 apogee.expose=3DapRaw-37790009, 10, A, Dark 07:32:21 apogee.expose=3DapRaw-37790010, 10, A, Dark ---------------------------------------- 07:31:54 loadCart: Cart 4, Plate 15173; 07:31:54 survey: BHM&MWM; lead: BHM lead 07:33:49 encl25m : open; 07:35:43 boss exposure 4.0, file=3D330700 07:36:21 boss exposure 4.0, file=3D330701 07:37:03 sp1.motor.move=3D 1648, 1646, 1646 07:37:03 Hartmann collimate output on cart #4 sp1: offset: r=3D 659 (In Focus); b=3D -8.3 (Out of focus) sp1: pred. move: spAverageMove=3D 1647 sp1: pred. resid: r=3D -988, b=3D -3.1, txt=3D OK, spTemp =3D 7.9 07:37:21 boss exposure 4.0, file=3D330702 07:38:48 boss exposure 25.0, file=3D330703 GSOGTF, seeing ~1.5", mostly clear. 07:43:03 apogee.expose=3DapRaw-37790011, 46, A, Object 07:43:10 boss exposure 900.0, file=3D330704 07:51:51 apogee.expose=3DapRaw-37790012, 46, A, Object 08:00:36 apogee.expose=3DapRaw-37790013, 46, A, Object 08:00:36 boss exposure 900.0, file=3D330705 08:08:47 apogee.expose=3DapRaw-37790014, 46, A, Object 08:16:57 apogee.expose=3DapRaw-37790015, 46, A, Object 08:16:57 boss exposure 900.0, file=3D330706 08:25:06 apogee.expose=3DapRaw-37790016, 46, A, Object 08:33:17 apogee.expose=3DapRaw-37790017, 46, A, Object 08:33:18 boss exposure 900.0, file=3D330707 08:41:28 apogee.expose=3DapRaw-37790018, 46, A, Object 08:49:45 apogee.expose=3DapRaw-37790019, 46, A, Object 08:49:45 boss exposure 900.0, file=3D330708 08:57:52 apogee.expose=3DapRaw-37790020, 46, A, Object 09:06:04 apogee.expose=3DapRaw-37790021, 46, A, Object 09:06:04 boss exposure 900.0, file=3D330709 09:14:13 apogee.expose=3DapRaw-37790022, 46, A, Object 09:22:25 apogee.expose=3DapRaw-37790023, 5, A, DomeFlat 09:23:04 apogee.expose=3DapRaw-37790024, 10, A, Dark 09:24:52 apogee.expose=3DapRaw-37790025, 10, A, Dark ---------------------------------------- flat=3D /data/apogee/utr_cdr/59341/apRaw-37790023.fits master=3D apRaw-21180043.fits nfibers=3D 300 Missing fibers: [20, 39, 151, 168, 186, 193, 211, 241, 273, 278] Faint fibers: ['121 - 129', '133 - 136', '140 - 141', '147 - 148', '152 - 156', '158 - 164', '166 - 167', '169 - 170', 172, 175, '177 - 180'] ----------------- 09:25:39 loadCart: Cart 8, Plate 15308; 09:25:39 survey: BHM&MWM; lead: BHM lead 09:28:25 boss exposure 4.0, file=3D330710 09:29:02 boss exposure 4.0, file=3D330711 09:29:45 sp1.motor.move=3D -2902, -2902, -2903 09:29:46 Hartmann collimate output on cart #8 sp1: offset: r=3D -3298 (Out of focus); b=3D 7.9 (Out of focus) sp1: pred. move: spAverageMove=3D -2902 sp1: pred. resid: r=3D -396, b=3D -1.2, txt=3D OK, spTemp =3D 6.7 09:30:05 boss exposure 4.0, file=3D330712 09:31:31 boss exposure 25.0, file=3D330713 GSOGTF, seeing ~1.5", mostly cloudy. 09:33:29 apogee.expose=3DapRaw-37790026, 46, A, Object 09:33:36 boss exposure 900.0, file=3D330714 09:41:38 apogee.expose=3DapRaw-37790027, 46, A, Object 09:49:49 apogee.expose=3DapRaw-37790028, 46, A, Object 09:49:56 boss exposure 900.0, file=3D330715 - aborted this one to try a boss iack no camCheck errors noted, no temperature issues. took a bias, flat and arc. Previous ones were rejected, no S/N measurements 09:53:39 boss exposure 0.0, file=3D330716 09:56:15 boss exposure 25.0, file=3D330717 09:59:01 boss exposure 4.0, file=3D330718 Continued to take data while sleuthing. Considered a cold restart and another iack, but decided to continue to take data. 10:05:41 apogee.expose=3DapRaw-37790029, 46, A, Object 10:05:46 boss exposure 900.0, file=3D330719 10:13:49 apogee.expose=3DapRaw-37790030, 46, A, Object 10:21:59 apogee.expose=3DapRaw-37790031, 46, A, Object 10:22:07 boss exposure 900.0, file=3D330720 10:30:09 apogee.expose=3DapRaw-37790032, 46, A, Object 10:38:20 apogee.expose=3DapRaw-37790033, 46, A, Object 10:38:26 boss exposure 900.0, file=3D330721 10:46:29 apogee.expose=3DapRaw-37790034, 46, A, Object 10:54:52 apogee.expose=3DapRaw-37790035, 5, A, DomeFlat 10:56:32 apogee.expose=3DapRaw-37790036, 10, A, Dark 10:58:20 apogee.expose=3DapRaw-37790037, 10, A, Dark 11:03:49 encl25m : closed; [observer@sdss4-hub ~]$ aptest 59341 37790035 flat=3D /data/apogee/utr_cdr/59341/apRaw-37790035.fits master=3D apRaw-21180043.fits nfibers=3D 300 Missing fibers: [35, 184, 211, 273] Faint fibers: ['121 - 180'] ----------------- 11:05Z- Started APOGEE and BOSS cals ---- BOSS Spectrograph Collimation Summary ---- --- Hartmann --- Time Cart TSP1 R1 B1 Move1 B1Resid =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D 23:51 2-15253A 9.1 329 -8.3 1482 -3.6 07:37 4-15173A 7.9 659 -8.3 1647 -3.1 09:30 8-15308A 6.7 -3298 7.9 -2902 -1.2 ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A: -4.9240 -4.9260 Axial B: -4.6800 -4.6830 Axial C: -5.7690 -5.7740 Trans D: -4.2970 -4.3170 Lateral E: 0.3750 0.3750 Lateral F: 0.5730 0.5710 GALILS Commanded: 5850 -4500 14850 28200 25200 24900 Actual: 5850 -4500 14850 28200 25200 24900 SETMIR VALUES PrimDesOrient: 0.0 69.89 100.0 375.3 622.11 PrimOrient: 0.04 69.89 100.0 375.3 622.11 SECONDARY: ---------- Focus: 0.0000 Air temp: 20.11 Altitude: 29.992871719465658 MIGS TONIGHT NOMINAL Axial A: -9.4490 -9.4490 Axial B: -9.4160 -9.4160 Axial C: -9.5050 -9.5000 Trans D: 0.0410 0.0440 GALILS Commanded: 4622450 4605850 4675450 -2000 -6600 Actual: 4604818 4587243 4633120 -2000 -6600 SETMIR VALUES SecDesOrient: 3657.0 -14.01 -2.9 12.5 114.22 SecOrient: 3656.9 -14.03 -2.81 12.75 114.22 ---- Telescope Offsets and Scale ---- --- Offsets --- (arcsec) Time Cart Az Alt Rot objOff guideRot calibOff guideRMS =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D 07:43 4-15173A 210.5 64.7 45.1 (0.0,-14.6) 81.8 ( 0, 0, 0) 0.294 07:59 4-15173A 214.2 62.9 51.7 (1.8,-14.3) 81.3 ( 0, 0, 0) 0.259 08:16 4-15173A 217.2 60.9 57.6 (2.9,-13.2) 83.3 ( 0, 0, 0) 0.291 08:32 4-15173A 219.7 58.7 63.0 (3.9,-12.3) 79.6 ( 0, 0, 0) 0.284 08:43 4-15173A 221.0 57.2 66.3 (4.4,-11.7) 76.0 ( 0, 0, 0) 0.360 08:48 4-15173A 221.6 56.5 67.9 (4.9,-11.3) 69.0 ( 0, 0, 0) 0.298 09:05 4-15173A 223.0 54.1 72.4 (5.8,-10.8) 68.1 ( 0, 0, 0) 0.302 09:16 4-15173A 223.8 52.5 75.3 (6.1,-10.2) 67.8 ( 0, 0, 0) 0.263 09:33 8-15308A 224.1 73.3 53.9 (-0.7,-8.7) 40.6 ( 0, 0, 0) 0.488 09:50 8-15308A 229.2 70.8 61.6 (0.3,-8.8) 41.8 ( 0, 0, 0) 0.520 10:05 8-15308A 232.6 68.2 67.6 (0.5,-8.4) 43.3 ( 0, 0, 0) 0.493 10:22 8-15308A 235.2 65.4 72.8 (2.2,-8.3) 42.9 ( 0, 0, 0) 0.411 10:38 8-15308A 236.9 62.6 77.2 (3.0,-8.1) 43.4 ( 0, 0, 0) 0.467 ---- Focus Log ---- --- Focus --- Time Cart Scale M1 M2 Focus Az Alt Temp Wind Dir FWHM =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D 07:43 4-15173A 300.0 -2962 1089 0 210.5 64.7 11.8 19 167 1.8 07:59 4-15173A 300.0 -2962 1059 -33 214.2 62.9 12.1 20 176 1.7 08:16 4-15173A 330.0 -3258 865 13 217.2 60.9 11.6 17 155 1.5 08:32 4-15173A 330.0 -3258 893 35 219.7 58.7 11.8 24 142 1.4 08:43 4-15173A 330.0 -3258 898 35 221.0 57.2 11.8 17 157 1.7 08:48 4-15173A 330.0 -3258 899 35 221.6 56.5 11.8 21 146 1.6 09:05 4-15173A 330.0 -3258 916 46 223.0 54.1 11.8 22 147 1.6 09:16 4-15173A 330.0 -3258 893 17 223.8 52.5 12.1 24 151 1.7 09:33 8-15308A 310.0 -3061 852 0 224.1 73.3 12.1 18 155 1.5 09:50 8-15308A 310.0 -3061 899 -96 229.2 70.8 12.4 17 172 1.3 10:05 8-15308A 250.0 -2468 1388 -102 232.6 68.2 12.4 15 174 1.4 10:22 8-15308A 250.0 -2468 1380 -115 235.2 65.4 12.1 11 179 1.4 10:38 8-15308A 250.0 -2468 1415 -87 236.9 62.6 11.8 17 174 1.3 ---- Telescope Status ---- 00:25Z Started ventilation 07:33Z encl25m : open 11:30Z encl25m : closed No interlocks bypassed Status at: 11:09Z Telescope stowed at: 121.0, 30.0, 0.0 mount Instrument mounted: cartridge =3D 2 Counterweights at: 481 483 481 480 LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 199 lbs, 19.8 psi ---- Software Used ---- Filesystem Size Used Avail Use% Mounted on /dev/vda2 7.7G 6.4G 929M 88% / tmpfs 3.4G 0 3.4G 0% /dev/shm /dev/vda1 194M 133M 52M 73% /boot /dev/vdb 19G 8.8G 9.1G 49% /exports/hub-local /dev/vdd 688G 605G 84G 88% /home /dev/vdc1 11T 7.6T 3.3T 70% /data 10.25.1.230:/data 21T 11T 9.2T 55% /sdss5_data -- STUI software: STUI : 1.7.12 alerts : 2.0.1 apo : v1_11 boss : 5.0.1 -boss.specMec : 3.0.4 gcamera : v2_2 guider : 3.9.5 hartmann : 1.8.0 hub : v4.2.4 mcp : 2.1 -mcp.plc : 34 -mcp.azFiduci : v1_145 -mcp.altFiduc : v1_145 -mcp.rotFiduc : v1_145 platedb : 2.8.0 sop : 4.0.8 tcc : 1.4.0 apogee : not availble apogeecal : not availble apogeeql : v1_7_0dev STUIAdditions : dgatlin -- Other versions ---- idlspec2d : v5_7_12 plate-mapper3 : NOCVS:v7_0_9 petunia : 2.2.3 autoscheduler : 1.5.4 sdss_python_module: trunk mangadrp : trunk exported ---- APOGEE Data Summary ---- [observer@sdss4-hub ~]$ list_ap -morning -m 59340 APOGEE data list, mjd=3D59340, morning raw_data: /data/apogee/utr_cdr/59340/apRaw-*.fits archive: /data/apogee/archive/59340/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/59340/ap2D-a-*.fits.fz ---------------------------------------------------------------------------= ----- mjd i UT File/Exp Imtype Nread A/B Dth Ct-Plate Arch Offset %Flux Comm ---------------------------------------------------------------------------= ----- 59340 1 11:06 37780078 Dark 60 A 13.0 2-15253 a-b-c - - 59340 2 11:16 37780079 Dark 60 A 13.0 2-15253 a-b-c - - 59340 3 11:27 37780080 Dark 60 A 13.0 2-15253 a-b-c - - 59340 4 11:38 37780081 QuarFlat 10 A 13.0 2-15253 a-b-c - 62 59340 5 11:40 37780082 QuarFlat 10 A 13.0 2-15253 a-b-c - 61 59340 6 11:41 37780083 QuarFlat 10 A 13.0 2-15253 a-b-c - 61 59340 7 11:43 37780084 Arc-Thar 12 A 13.0 2-15253 a-b-c -1.45 - 59340 8 11:45 37780085 Arc-Thar 12 A 13.0 2-15253 a-b-c -1.44 - 59340 9 11:48 37780086 Arc-Une 40 A 13.0 2-15253 a-b-c - - 59340 10 11:55 37780087 Arc-Une 40 A 13.0 2-15253 a-b-c - - 59340 11 12:02 37780088 Dark 30 A 13.0 2-15253 a-b-c - - 59340 12 12:07 37780089 InteFlat 30 A 13.0 2-15253 a-b-c - 0 59340 13 12:13 37780090 InteFlat 30 A 13.0 2-15253 a-b-c - 0 59340 14 12:18 37780091 InteFlat 30 A 13.0 2-15253 a-b-c - 0 59340 15 12:23 37780092 Dark 30 A 13.0 2-15253 a-b-c - - ---------------------------------------------------------------------------= ----- ---- Weather Log ---- --- Weather --- Time Cart Temp DP Diff Humid Wind Dir 1umDst IRSCSig IRSCm =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D 07:43 4-15173A 11.8 3.3 8.5 56 19 167 1891 2.6 330.0 07:59 4-15173A 12.1 3.3 8.8 54 20 176 1711 2.0 330.0 08:16 4-15173A 11.6 3.6 8.0 57 17 155 1615 51.1 343.0 08:32 4-15173A 11.8 3.2 8.6 55 24 142 1724 57.7 351.0 08:43 4-15173A 11.8 3.1 8.7 55 17 157 1473 92.5 369.0 08:48 4-15173A 11.8 3.1 8.7 55 21 146 1488 62.9 363.0 09:05 4-15173A 11.8 2.9 8.9 54 22 147 1600 39.7 349.0 09:16 4-15173A 12.1 2.4 9.7 51 24 151 1488 67.4 343.0 09:33 8-15308A 12.1 2.5 9.6 51 18 155 1511 88.6 381.0 09:50 8-15308A 12.4 1.7 10.7 47 17 172 1345 58.2 348.0 10:05 8-15308A 12.4 2.0 10.4 49 15 174 1198 38.7 338.0 10:22 8-15308A 12.1 2.1 10.0 50 11 179 986 17.9 331.0 10:38 8-15308A 11.8 2.3 9.5 52 17 174 1315 2.1 330.0 ---- Problems in Detail ---- Cart 4 SOS warnings: sdR-r1-00330702.fit.gz: INFO: Arc exposure, waiting for flat before reducing sdR-b1-00330702.fit.gz: WARNING: Cd I 3610 line missing (lamps not warm?) sdR-r1-00330705.fit.gz: WARNING: r1 Amp 3 high read noise =3D 7.31 sdR-b1-00330707.fit.gz: WARNING: b1 Amp 0 high read noise =3D ***** sdR-b1-00330707.fit.gz: WARNING: Scattered light max =3D 1092 electrons (Warm CCD or twi?) sdR-b1-00330708.fit.gz: WARNING: b1 Amp 0 high read noise =3D ***** sdR-b1-00330708.fit.gz: WARNING: Scattered light max =3D 5166 electrons (Warm CCD or twi?) sdR-b1-00330709.fit.gz: WARNING: b1 Amp 0 high read noise =3D ***** sdR-b1-00330709.fit.gz: WARNING: Scattered light max =3D 3065 electrons (Warm CCD or twi?) sdR-b1-00330709.fit.gz: WARNING: Median spatial widths =3D 1.50 0.98 1.02 1.02 pix (Left Bottom Top Right) Nothing strange in the images before 330706. Hartmanns look ok. Both b1 and r1 seem to be affected, so there's a shared connection with the problem Cart 8 SOS warnings: sdR-b1-00330713.fit.gz: WARNING: Electronics shifted 8 rows by 1 pix sdR-b1-00330713.fit.gz: WARNING: Electronics shifted 24 rows by 2 pix sdR-b1-00330713.fit.gz: WARNING: Electronics shifted 2 rows by 4 pix sdR-b1-00330713.fit.gz: WARNING: Electronics shifted 4 rows by 5 pix sdR-b1-00330713.fit.gz: WARNING: Reject flat: 16% bad pixels sdR-b1-00330713.fit.gz: ABORT: Unable to reduce flat sdR-b1-00330712.fit.gz: INFO: Arc exposure, waiting for flat before reducing sdR-r1-00330713.fit.gz: WARNING: Reject flat: 18% bad pixels sdR-r1-00330713.fit.gz: ABORT: Unable to reduce flat sdR-r1-00330712.fit.gz: INFO: Arc exposure, waiting for flat before reducing sdR-b1-00330716.fit.gz: WARNING: b1 Amp 0 high read noise =3D ***** sdR-b1-00330717.fit.gz: WARNING: Electronics shifted 2 rows by 1 pix sdR-b1-00330717.fit.gz: WARNING: Electronics shifted 16 rows by 2 pix sdR-b1-00330717.fit.gz: WARNING: Electronics shifted 4 rows by 3 pix sdR-b1-00330717.fit.gz: WARNING: b1 Amp 0 high read noise =3D ***** sdR-b1-00330717.fit.gz: WARNING: Reject flat: 15% bad pixels sdR-b1-00330717.fit.gz: ABORT: Unable to reduce flat sdR-r1-00330717.fit.gz: WARNING: Electronics shifted 20 rows by 1 pix sdR-r1-00330717.fit.gz: WARNING: Electronics shifted 2 rows by 4 pix sdR-r1-00330717.fit.gz: WARNING: Reject flat: 19% bad pixels sdR-r1-00330717.fit.gz: ABORT: Unable to reduce flat sdR-b1-00330718.fit.gz: INFO: Arc exposure, waiting for flat before reducing sdR-r1-00330718.fit.gz: INFO: Arc exposure, waiting for flat before reducing sdR-b1-00330719.fit.gz: ABORT: Unable to reduce this science exposure (need flat) sdR-b1-00330719.fit.gz: ABORT: Unable to reduce this science exposure (need arc) ____________________________________________________________ Logs of Nightly APO Activities > https://trac.sdss.org/tracmailman/browser/private/sloan-25mlog/index.html _______________________________________________________= _____ Logs of Nightly APO Activities > https://trac.sdss.org/tracmailman/browser/private/sloan-25mlog/index.html --_000_DM6PR11MB29241AF40AA52722FD97F747B5579DM6PR11MB2924namp_ Content-Type: text/html; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable P {margin-top:0;margin-bo= ttom:0;} Hi, I take a look at the final reductions, some spectra have a catastrophic= reduction just at 6000-8000 AA (https://data.sdss5.org/sas/sdsswork/= bhm/boss/spectro/redux/images/master/master/15173-59341/spec-image-15173-59= 341-04351094424.png), but for other spectra, the reductions look fine (https://data.sdss5.= org/sas/sdsswork/bhm/boss/spectro/redux/images/master/master/15173-59341/sp= ec-image-15173-59341-04350970055.png). I could let the pipeline automatically flag those spectra (for the most of= the bad spectra the pipeline flag them with "negative_emision" f= lag) . Yue, that it is ok for the RM? The other option is discard all the b= ad exposures (or all the plate) leaving only 15-minutes for thise mjd. Hector Ibarra From: Ibarra Medel, Hector = Javier Sent: Friday, May 7, 2021 3:38 PM To: Kaike Pan ; Jonathan Trump Cc: obs-report-25m@apo.nmsu.edu ;= sdss_local@apo.nmsu.edu ; Shen, Yue Subject: Re: [sloan-25mlog 5512] 2.5m obslog 20210506 (SJD 59341) Thanks Kaike, it appears that this issue impacts on the plate 15173-59= 341 that is an RM plate, the full reductions are almost finished and we can= inspect how this issue impacts in the final reductions. " In other words, you may wa= nt to consider to declare all BOSS science data (except for the first frame, 330704) from last night as bad= data." This make usable only one 15 minute expos= ure from the 6 taken for that specific plate. My proposed solution is= to flag those spectra or dependig on how bad the final reductions looks, completly discard these exposures. Many thanks Hector Ibarra From: Kaike Pan Sent: Friday, May 7, 2021 3:00 PM To: Ibarra Medel, Hector Javier ; Jonat= han Trump Cc: obs-report-25m@apo.nmsu.edu ;= sdss_local@apo.nmsu.edu Subject: Re: [sloan-25mlog 5512] 2.5m obslog 20210506 (SJD 59341) Hello All, Thanks to Dan and Katie who take some bias, dark, an= d a set of flat and arc. After 10 darks and one dark, impacts of the issue was greatly reduced. However= , I still see some sign of the impact (see attached image for exposure 330732). Hector and Jon: I checked the data took last night, I see i= mpacts of the electronic issue except for the first science exposure, 330704. In other words, you may want to c= onsider to declare all BOSS science data (except for the first frame, 330704) from last night as bad data. I took a set of flat and arc today, the data looks good. On= e had the issue last year, and it fixed itself. It=92s good thing is that it works since then, but the bad thing is that we d= on=92t understand what cause it and have no procedure on how to fix the issue. Thanks, -Kaike On May 7, 2021, at 5:38 AM, Daniel Oravetz wrote= : FYI, the biases taken during the morning cals sequence look good and the= SOS 98th percentile stats are normal, too. Screenshot attached. Dan and Katie Attached are screenshots of an arc and flat taken on cartridge 8 that shows the electronics shift SOS warned about. &nb= sp; APACHE POINT OBSER= VATORY SDSS 2.5M &nb= sp; = OBSERVING LOG &nb= sp; = Thursday May 06, 2021 &nb= sp; = (SJD 59341) ---- Observing Team ---- Dan Oravetz Katie Grabowski ---- Observing Plan ---- Thu 06 May 2021 59341 0.18 03:04 10:55 = 11:01 18:53 --- KP BHM ( 7.8 h) ---- Observing Summary ---- Lost 4.7 hours of BHM due to weather. dust=3D22k Unusual SOS warning for both cartridges 4 and 8. Listed in Problems section. Cart.4, plate 15173, RM_SDSS-RM, GSOGTF, 12xA+6xB, not done Missing fibers: [20, 39, 151, 168, 186, 193, 211, 241, 273, 278] Faint fibers: ['121 - 129', '133 - 136', '140 - 141', '147 - 14= 8', '152 - 156', '158 - 164', '166 - 167', '169 - 170', 172, 175, '177 - 180'] ----------------- Cart.8, plate 15308, AQM_246.49_+43.80, GSOGTF, 8xA+4xB, not done Missing fibers: [35, 184, 211, 273] Faint fibers: ['121 - 180'] ----------------- ---- Observing Log ---- Afternoon: =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D All systems alive and responsive. 23:44Z- Started APOGEE cals 23:44:28 boss exposure 0.0, file=3D330694 23:45:47 boss exposure 20.0, file=3D330695 23:48:17 boss exposure 4.0, file=3D330696 23:49:27 boss exposure 4.0, file=3D330697 23:50:51 sp1.motor.move=3D 1482, 1483, 1483 23:50:51 Hartmann collimate output on cart #2 sp1: offset: r=3D 329 (In Focus); b=3D -8.3 (Out of focus= ) sp1: pred. move: spAverageMove=3D 1482 sp1: pred. resid: r=3D -1153, b=3D -3.6, txt=3D OK, spTemp =3D = 9.1 Did not adjust blue rings. 23:57:37 boss exposure 25.0, file=3D330698 00:00:25 boss exposure 4.0, file=3D330699 00:25Z- Started ventilation. Night: =3D=3D=3D=3D=3D=3D Radar and clouds kept us closed. Radar dissipating and sky clearing. 07:30:34 apogee.expose=3DapRaw-37790009, 10, A, Dark 07:32:21 apogee.expose=3DapRaw-37790010, 10, A, Dark ---------------------------------------- 07:31:54 loadCart: Cart 4, Plate 15173; 07:31:54 survey: BHM&MWM; lead: BHM lead 07:33:49 encl25m : open; 07:35:43 boss exposure 4.0, file=3D330700 07:36:21 boss exposure 4.0, file=3D330701 07:37:03 sp1.motor.move=3D 1648, 1646, 1646 07:37:03 Hartmann collimate output on cart #4 sp1: offset: r=3D 659 (In Focus); b=3D -8.3 (Out of focus= ) sp1: pred. move: spAverageMove=3D 1647 sp1: pred. resid: r=3D -988, b=3D -3.1, txt=3D OK, spTemp =3D 7= .9 07:37:21 boss exposure 4.0, file=3D330702 07:38:48 boss exposure 25.0, file=3D330703 GSOGTF, seeing ~1.5", mostly clear. 07:43:03 apogee.expose=3DapRaw-37790011, 46, A, Object 07:43:10 boss exposure 900.0, file=3D330704 07:51:51 apogee.expose=3DapRaw-37790012, 46, A, Object 08:00:36 apogee.expose=3DapRaw-37790013, 46, A, Object 08:00:36 boss exposure 900.0, file=3D330705 08:08:47 apogee.expose=3DapRaw-37790014, 46, A, Object 08:16:57 apogee.expose=3DapRaw-37790015, 46, A, Object 08:16:57 boss exposure 900.0, file=3D330706 08:25:06 apogee.expose=3DapRaw-37790016, 46, A, Object 08:33:17 apogee.expose=3DapRaw-37790017, 46, A, Object 08:33:18 boss exposure 900.0, file=3D330707 08:41:28 apogee.expose=3DapRaw-37790018, 46, A, Object 08:49:45 apogee.expose=3DapRaw-37790019, 46, A, Object 08:49:45 boss exposure 900.0, file=3D330708 08:57:52 apogee.expose=3DapRaw-37790020, 46, A, Object 09:06:04 apogee.expose=3DapRaw-37790021, 46, A, Object 09:06:04 boss exposure 900.0, file=3D330709 09:14:13 apogee.expose=3DapRaw-37790022, 46, A, Object 09:22:25 apogee.expose=3DapRaw-37790023, 5, A, DomeFlat 09:23:04 apogee.expose=3DapRaw-37790024, 10, A, Dark 09:24:52 apogee.expose=3DapRaw-37790025, 10, A, Dark ---------------------------------------- flat=3D /data/apogee/utr_cdr/59341/apRaw-37790023.fits master=3D apRaw-21180043.fits nfibers=3D 300 Missing fibers: [20, 39, 151, 168, 186, 193, 211, 241, 273, 278] Faint fibers: ['121 - 129', '133 - 136', '140 - 141', '147 - 14= 8', '152 - 156', '158 - 164', '166 - 167', '169 - 170', 172, 175, '177 - 180'] ----------------- 09:25:39 loadCart: Cart 8, Plate 15308; 09:25:39 survey: BHM&MWM; lead: BHM lead 09:28:25 boss exposure 4.0, file=3D330710 09:29:02 boss exposure 4.0, file=3D330711 09:29:45 sp1.motor.move=3D -2902, -2902, -2903 09:29:46 Hartmann collimate output on cart #8 sp1: offset: r=3D -3298 (Out of focus); b=3D 7.9 (Out of = focus) sp1: pred. move: spAverageMove=3D -2902 sp1: pred. resid: r=3D -396, b=3D -1.2, txt=3D OK, spTemp =3D 6= .7 09:30:05 boss exposure 4.0, file=3D330712 09:31:31 boss exposure 25.0, file=3D330713 GSOGTF, seeing ~1.5", mostly cloudy. 09:33:29 apogee.expose=3DapRaw-37790026, 46, A, Object 09:33:36 boss exposure 900.0, file=3D330714 09:41:38 apogee.expose=3DapRaw-37790027, 46, A, Object 09:49:49 apogee.expose=3DapRaw-37790028, 46, A, Object 09:49:56 boss exposure 900.0, file=3D330715 - aborted this one = to try a boss iack no camCheck errors noted, no temperature issues. took a bias, flat and arc. Previous ones were rejected, no S/N measurements 09:53:39 boss exposure 0.0, file=3D330716 09:56:15 boss exposure 25.0, file=3D330717 09:59:01 boss exposure 4.0, file=3D330718 Continued to take data while sleuthing. Considered a cold restart and another iack, but decided to continue to take data. 10:05:41 apogee.expose=3DapRaw-37790029, 46, A, Object 10:05:46 boss exposure 900.0, file=3D330719 10:13:49 apogee.expose=3DapRaw-37790030, 46, A, Object 10:21:59 apogee.expose=3DapRaw-37790031, 46, A, Object 10:22:07 boss exposure 900.0, file=3D330720 10:30:09 apogee.expose=3DapRaw-37790032, 46, A, Object 10:38:20 apogee.expose=3DapRaw-37790033, 46, A, Object 10:38:26 boss exposure 900.0, file=3D330721 10:46:29 apogee.expose=3DapRaw-37790034, 46, A, Object 10:54:52 apogee.expose=3DapRaw-37790035, 5, A, DomeFlat 10:56:32 apogee.expose=3DapRaw-37790036, 10, A, Dark 10:58:20 apogee.expose=3DapRaw-37790037, 10, A, Dark 11:03:49 encl25m : closed; [observer@sdss4-hub ~]$ aptest 59341 37790035 flat=3D /data/apogee/utr_cdr/59341/apRaw-37790035.fits master=3D apRaw-21180043.fits nfibers=3D 300 Missing fibers: [35, 184, 211, 273] Faint fibers: ['121 - 180'] ----------------- 11:05Z- Started APOGEE and BOSS cals ---- BOSS Spectrograph Collimation Summary ---- --- Hartmann --- Time Cart TSP1 R1 &nb= sp; B1 Move1 B1Resid =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D 23:51 2-15253A 9.1 329 -8.3 1482 = -3.6 07:37 4-15173A 7.9 659 -8.3 1647 = -3.1 09:30 8-15308A 6.7 -3298 7.9 -2902 &nbs= p;-1.2 ---- Mirror Numbers ---- PRIMARY: -------- Scale: 1.000000 MIGS = TONIG= HT NOMINAL Axial A: -4.9240 -4.9260 Axial B: -4.6800 -4.6830 Axial C: -5.7690 -5.7740 Trans D: -4.2970 -4.3170 Lateral E: 0.3750 0.3750 Lateral F: 0.5730 0.5710 GALILS Commanded: 5850 -4500 14850 28200 25200 24900 Actual: 5850 -4500 14850 28200 25200 24900 SETMIR VALUES PrimDesOrient: 0.0 69.89 100.0 375.3 622.11 PrimOrient: 0.04 69.89 100.0 375.3 622.11 SECONDARY: ---------- Focus: 0.0000 Air temp: 20.11 Altitude: 29.992871719465658 MIGS = TONIG= HT NOMINAL Axial A: -9.4490 -9.4490 Axial B: -9.4160 -9.4160 Axial C: -9.5050 -9.5000 Trans D: 0.0410 0.0440 GALILS Commanded: 4622450 4605850 4675450 -2000 -6600 Actual: 4604818 4587243 4633120 -2000 -6600 SETMIR VALUES SecDesOrient: 3657.0 -14.01 -2.9 12.5 114.22 SecOrient: 3656.9 -14.03 -2.81 12.75 114.22 ---- Telescope Offsets and Scale ---- --- Offsets --- (arcsec) Time Cart Az &n= bsp;Alt Rot objOff &n= bsp;guideRot calibOff guideRMS =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D 07:43 4-15173A 210.5 64.7 45.1 (0.0,-14.6) &n= bsp; 81.8 ( 0, 0, 0) 0.294 07:59 4-15173A 214.2 62.9 51.7 (1.8,-14.3) &n= bsp; 81.3 ( 0, 0, 0) 0.259 08:16 4-15173A 217.2 60.9 57.6 (2.9,-13.2) &n= bsp; 83.3 ( 0, 0, 0) 0.291 08:32 4-15173A 219.7 58.7 63.0 (3.9,-12.3) &n= bsp; 79.6 ( 0, 0, 0) 0.284 08:43 4-15173A 221.0 57.2 66.3 (4.4,-11.7) &n= bsp; 76.0 ( 0, 0, 0) 0.360 08:48 4-15173A 221.6 56.5 67.9 (4.9,-11.3) &n= bsp; 69.0 ( 0, 0, 0) 0.298 09:05 4-15173A 223.0 54.1 72.4 (5.8,-10.8) &n= bsp; 68.1 ( 0, 0, 0) 0.302 09:16 4-15173A 223.8 52.5 75.3 (6.1,-10.2) &n= bsp; 67.8 ( 0, 0, 0) 0.263 09:33 8-15308A 224.1 73.3 53.9 (-0.7,-8.7) &n= bsp; 40.6 ( 0, 0, 0) 0.488 09:50 8-15308A 229.2 70.8 61.6 (0.3,-8.8) &nb= sp; 41.8 ( 0, 0, 0) 0.520 10:05 8-15308A 232.6 68.2 67.6 (0.5,-8.4) &nb= sp; 43.3 ( 0, 0, 0) 0.493 10:22 8-15308A 235.2 65.4 72.8 (2.2,-8.3) &nb= sp; 42.9 ( 0, 0, 0) 0.411 10:38 8-15308A 236.9 62.6 77.2 (3.0,-8.1) &nb= sp; 43.4 ( 0, 0, 0) 0.467 ---- Focus Log ---- --- Focus --- Time Cart Scale M1 &n= bsp; M2 Focus Az Alt &= nbsp; Temp Wind Dir FWHM =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D 07:43 4-15173A 300.0 -2962 1089 &= nbsp;0 210.5 64.7 11.8 19 167 1.8 07:59 4-15173A 300.0 -2962 1059 -33 &nb= sp;214.2 62.9 12.1 20 176 1.7 08:16 4-15173A 330.0 -3258 865 &n= bsp;13 217.2 60.9 11.6 17 155 1.5 08:32 4-15173A 330.0 -3258 893 &n= bsp;35 219.7 58.7 11.8 24 142 1.4 08:43 4-15173A 330.0 -3258 898 &n= bsp;35 221.0 57.2 11.8 17 157 1.7 08:48 4-15173A 330.0 -3258 899 &n= bsp;35 221.6 56.5 11.8 21 146 1.6 09:05 4-15173A 330.0 -3258 916 &n= bsp;46 223.0 54.1 11.8 22 147 1.6 09:16 4-15173A 330.0 -3258 893 &n= bsp;17 223.8 52.5 12.1 24 151 1.7 09:33 8-15308A 310.0 -3061 852 &n= bsp; 0 224.1 73.3 12.1 18 155 1.5 09:50 8-15308A 310.0 -3061 899 -9= 6 229.2 70.8 12.4 17 172 1.3 10:05 8-15308A 250.0 -2468 1388 -102 23= 2.6 68.2 12.4 15 174 1.4 10:22 8-15308A 250.0 -2468 1380 -115 23= 5.2 65.4 12.1 11 179 1.4 10:38 8-15308A 250.0 -2468 1415 -87 &nb= sp;236.9 62.6 11.8 17 174 1.3 ---- Telescope Status ---- 00:25Z Started ventilation 07:33Z encl25m : open 11:30Z encl25m : closed No interlocks bypassed Status at: 11:09Z Telescope stowed at: 121.0, 30.0, 0.0 m= ount Instrument mounted: cartridge =3D 2 Counterweights at: 481 483 481 480 LN2 autofill systems: Connected and turned on 180L LN2 dewar scales: SP1 199 lbs, 19.= 8 psi ---- Software Used ---- Filesystem Size Used = Avail Use% Mounted on /dev/vda2 7.7G = 6.4G 929M 88% / tmpfs &nb= sp; 3.4G 0 3.4G 0% /dev/shm /dev/vda1 194M = 133M 52M 73% /boot /dev/vdb = 19G 8.8G 9.1G 49% /exports/hub-local /dev/vdd 688G &= nbsp;605G 84G 88% /home /dev/vdc1 11T &= nbsp;7.6T 3.3T 70% /data 10.25.1.230:/data 21T 11T 9.2T 55% /sds= s5_data -- STUI software: STUI : 1.7.12 alerts : 2.0.1 apo : v1_11 boss : 5.0.1 -boss.specMec : 3.0.4 gcamera : v2_2 guider : 3.9.5 hartmann : 1.8.0 hub : v4.2.4 mcp : 2.1 -mcp.plc : 34 -mcp.azFiduci : v1_145 -mcp.altFiduc : v1_145 -mcp.rotFiduc : v1_145 platedb : 2.8.0 sop : 4.0.8 tcc : 1.4.0 apogee : not availble apogeecal : not availble apogeeql : v1_7_0dev STUIAdditions : dgatlin -- Other versions ---- idlspec2d : v5_7_12 plate-mapper3 : NOCVS:v7_0_9 petunia : 2.2.3= autoscheduler : 1.5.4 sdss_python_module: trunk mangadrp : trunk expo= rted ---- APOGEE Data Summary ---- [observer@sdss4-hub ~]$ list_ap -morning -m 59340 APOGEE data list, mjd=3D59340, morning raw_data: /data/apogee/utr_cdr/59340/apRaw-*.fits archive: /data/apogee/archive/59340/apR-[a,b,c]-*.apz quickred: /data/apogee/quickred/59340/ap2D-a-*.fits.fz ---------------------------------------------------------------------------= ----- mjd i UT File/Exp Imt= ype Nread A/B Dth Ct-Plate Arch Offset %Flux Comm ---------------------------------------------------------------------------= ----- 59340 1 11:06 37780078 Dark  = ;60 A 13.0 2-15253 a-b-c - - 59340 2 11:16 37780079 Dark  = ;60 A 13.0 2-15253 a-b-c - - 59340 3 11:27 37780080 Dark  = ;60 A 13.0 2-15253 a-b-c - - 59340 4 11:38 37780081 QuarFlat 10 A 13= .0 2-15253 a-b-c - 62 59340 5 11:40 37780082 QuarFlat 10 A 13= .0 2-15253 a-b-c - 61 59340 6 11:41 37780083 QuarFlat 10 A 13= .0 2-15253 a-b-c - 61 59340 7 11:43 37780084 Arc-Thar 12 A 13= .0 2-15253 a-b-c -1.45 - 59340 8 11:45 37780085 Arc-Thar 12 A 13= .0 2-15253 a-b-c -1.44 - 59340 9 11:48 37780086 Arc-Une 40 A &nb= sp;13.0 2-15253 a-b-c - - 59340 10 11:55 37780087 Arc-Une 40 A 13= .0 2-15253 a-b-c - - 59340 11 12:02 37780088 Dark 30 &= nbsp;A 13.0 2-15253 a-b-c - - 59340 12 12:07 37780089 InteFlat 30 A 13.0 &n= bsp; 2-15253 a-b-c - 0 59340 13 12:13 37780090 InteFlat 30 A 13.0 &n= bsp; 2-15253 a-b-c - 0 59340 14 12:18 37780091 InteFlat 30 A 13.0 &n= bsp; 2-15253 a-b-c - 0 59340 15 12:23 37780092 Dark 30 &= nbsp;A 13.0 2-15253 a-b-c - - ---------------------------------------------------------------------------= ----- ---- Weather Log ---- --- Weather --- Time Cart Temp DP &nb= sp;Diff Humid Wind Dir 1umDst IRSCSig IRSCm =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D 07:43 4-15173A 11.8 3.3 8.5  = ;56 19 167 1891 2.6 330.0 07:59 4-15173A 12.1 3.3 8.8  = ;54 20 176 1711 2.0 330.0 08:16 4-15173A 11.6 3.6 8.0  = ;57 17 155 1615 51.1 343.0 08:32 4-15173A 11.8 3.2 8.6  = ;55 24 142 1724 57.7 351.0 08:43 4-15173A 11.8 3.1 8.7  = ;55 17 157 1473 92.5 369.0 08:48 4-15173A 11.8 3.1 8.7  = ;55 21 146 1488 62.9 363.0 09:05 4-15173A 11.8 2.9 8.9  = ;54 22 147 1600 39.7 349.0 09:16 4-15173A 12.1 2.4 9.7  = ;51 24 151 1488 67.4 343.0 09:33 8-15308A 12.1 2.5 9.6  = ;51 18 155 1511 88.6 381.0 09:50 8-15308A 12.4 1.7 10.7 47 &= nbsp; 17 172 1345 58.2 348.0 10:05 8-15308A 12.4 2.0 10.4 49 &= nbsp; 15 174 1198 38.7 338.0 10:22 8-15308A 12.1 2.1 10.0 50 &= nbsp; 11 179 986 17.9 331.0 10:38 8-15308A 11.8 2.3 9.5  = ;52 17 174 1315 2.1 330.0 ---- Problems in Detail ---- Cart 4 SOS warnings: sdR-r1-00330702.fit.gz: INFO: Arc exposure, waiting for flat before reducing sdR-b1-00330702.fit.gz: WARNING: Cd I 3610 line missing (lamps not warm?) sdR-r1-00330705.fit.gz: WARNING: r1 Amp 3 high read noise =3D 7.31 sdR-b1-00330707.fit.gz: WARNING: b1 Amp 0 high read noise =3D ***** sdR-b1-00330707.fit.gz: WARNING: Scattered light max =3D 1092 electro= ns (Warm CCD or twi?) sdR-b1-00330708.fit.gz: WARNING: b1 Amp 0 high read noise =3D ***** sdR-b1-00330708.fit.gz: WARNING: Scattered light max =3D 5166 electro= ns (Warm CCD or twi?) sdR-b1-00330709.fit.gz: WARNING: b1 Amp 0 high read noise =3D ***** sdR-b1-00330709.fit.gz: WARNING: Scattered light max =3D 3065 electro= ns (Warm CCD or twi?) sdR-b1-00330709.fit.gz: WARNING: Median spatial widths =3D 1.50 0.98 = 1.02 1.02 pix (Left Bottom Top Right) Nothing strange in the images before 330706. Hartmanns look ok. Both b1 and r1 seem to be affected, so there's a shared connection with the problem Cart 8 SOS warnings: sdR-b1-00330713.fit.gz: WARNING: Electronics shifted 8 rows by = 1 pix sdR-b1-00330713.fit.gz: WARNING: Electronics shifted 24 rows by  = ;2 pix sdR-b1-00330713.fit.gz: WARNING: Electronics shifted 2 rows by = 4 pix sdR-b1-00330713.fit.gz: WARNING: Electronics shifted 4 rows by = 5 pix sdR-b1-00330713.fit.gz: WARNING: Reject flat: 16% bad pixels sdR-b1-00330713.fit.gz: ABORT: Unable to reduce flat sdR-b1-00330712.fit.gz: INFO: Arc exposure, waiting for flat before reducing sdR-r1-00330713.fit.gz: WARNING: Reject flat: 18% bad pixels sdR-r1-00330713.fit.gz: ABORT: Unable to reduce flat sdR-r1-00330712.fit.gz: INFO: Arc exposure, waiting for flat before reducing sdR-b1-00330716.fit.gz: WARNING: b1 Amp 0 high read noise =3D ***** sdR-b1-00330717.fit.gz: WARNING: Electronics shifted 2 rows by = 1 pix sdR-b1-00330717.fit.gz: WARNING: Electronics shifted 16 rows by  = ;2 pix sdR-b1-00330717.fit.gz: WARNING: Electronics shifted 4 rows by = 3 pix sdR-b1-00330717.fit.gz: WARNING: b1 Amp 0 high read noise =3D ***** sdR-b1-00330717.fit.gz: WARNING: Reject flat: 15% bad pixels sdR-b1-00330717.fit.gz: ABORT: Unable to reduce flat sdR-r1-00330717.fit.gz: WARNING: Electronics shifted 20 rows by  = ;1 pix sdR-r1-00330717.fit.gz: WARNING: Electronics shifted 2 rows by = 4 pix sdR-r1-00330717.fit.gz: WARNING: Reject flat: 19% bad pixels sdR-r1-00330717.fit.gz: ABORT: Unable to reduce flat sdR-b1-00330718.fit.gz: INFO: Arc exposure, waiting for flat before reducing sdR-r1-00330718.fit.gz: INFO: Arc exposure, waiting for flat before reducing sdR-b1-00330719.fit.gz: ABORT: Unable to reduce this science exposure (need flat) sdR-b1-00330719.fit.gz: ABORT: Unable to reduce this science exposure (need arc) ____________________________________________________________ Logs of Nightly APO Activities https://trac.sdss.org= /tracmailman/browser/private/sloan-25mlog/index.html __________________________________________________= __________ Logs of Nightly APO Activities https://trac.sdss.org/tracmailman/browser/private/sloan-25mlog/i= ndex.html --_000_DM6PR11MB29241AF40AA52722FD97F747B5579DM6PR11MB2924namp_--