Btukfyl

I'm trying to capture all network traffic that we can see in Network tab of chromedevtools. After capturing network traffic, i'm filtering it to get only .m3u8 urls. I'm using seleniumwire with chromedriver for this purpose. I was able to capture .m3u8 link using the below script from this url:

https://www.canlitv.video/atv

But it is not working for these urls:

http://www.lalegultv.com.tr/canli-yayin

https://www.kanald.com.tr/canli-yayin    

Here is the script that i'm using.

from seleniumwire import webdriver 

from selenium.webdriver.chrome.options import Options

from fake_useragent import UserAgent

from selenium.webdriver.common.desired_capabilities import DesiredCapabilities    



ua = UserAgent()



d = DesiredCapabilities.CHROME



chrome_options = Options()

#chrome_options.headless = True

chrome_options.add_argument("--user-agent='"+ua.chrome+"'")

chrome_options.add_argument('--ignore-certificate-errors')

chrome_options.add_argument('--no-sandbox')

chrome_options.add_argument('--disable-gpu')

chrome_options.add_argument('--disable-dev-shm-usage')

chrome_options.add_argument('--lang=en-GB,en-US;q=0.9,en;q=0.8')

# chrome_options.add_argument("--headless")

chrome_options.add_argument('--log-level=3')

chrome_options.add_argument("--start-maximized")

driver = webdriver.Chrome(chrome_options=chrome_options,service_args=["--verbose", "--log-path=C:/errors/chromedriver.log"],desired_capabilities=d)



# url = "https://www.kanald.com.tr/canli-yayin"

url = "http://www.lalegultv.com.tr/canli-yayin"



driver.get(url)



# logs all traffic inclusing .js, .png, .ico loads in a file named log.csv

f = open("traffic.csv","w")



for request in driver.requests:

    try:

        line = str(request.path) + "," + str(request.response.status_code) + "," + str(request.response.headers['Content-Type']) + "n" 

        f.write(line)

    except:

        pass

    if request.response:

        if ".m3u8" in request.path:

            if request.path[-4:] == ".m3u8":

                print(request.path)

            if ".m3u8?" in request.path:

                print(request.path)

f.close()       



print("Testing logs --- ")

for entry in driver.get_log('browser'):

    print(entry)



# driver.quit()

I tried in headless mode but the script is not fetching .m3u8 url. So i tried in headed mode, and i noticed a problem. When the page is loaded in normal browser the video is loading. But when launched using chromedriver it is not loading the video. Can anyone please help me fix this problem. You may please connect with me to discuss here. My aim is to get .m3u8 url from the urls that i give. I'm open to alternate solution.

Chrome Browser - Your connection to this site is not secure

Here are some additional details:

ChromeDriver 2.44.609538

Python 3.5.0

Selenium 3.141.0

Selenium-wire 0.10.0

Google Chrome 70.0.3538.102 (Official Build) (64-bit)