In general, diesels have three paths to shed heat: coolant, oil, exhaust. While your oil may not break down from the higher temp due to a lack of oil cooler, the engine will suffer. The pistons get a shot of oil directed at their underside to absorb & carry off heat from the crown. Keep the cooler, your engine will thank you.